Popular GitHub Repositories for Parameter Efficient

? Empowering everyone to build reliable and efficient smart contracts.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

?? 「大模型」2小时完全从0训练26M的小参数GPT！? Train a 26M-parameter GPT from scratch in just 2h!

? The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

??HivisionIDPhotos: a lightweight and efficient AI ID photos tools. 一个轻量级的AI证件照制作算法。

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.

? 卡卡字幕助手 | VideoCaptioner - 基于 LLM 的智能字幕助手 - 视频字幕生成、断句、校正、字幕翻译全流程处理！- A powered tool for easy and efficient video subtitling.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Use PEFT or Full-parameter to finetune 450+ LLMs (Qwen2.5, InternLM3, GLM4, Llama3.3, Mistral, Yi1.5, Baichuan2, DeepSeek-R1, ...) and 150+ MLLMs (Qwen2.5-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2.5, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL2, Phi3.5-Vision, GOT-OCR2, ...).

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

A Flexible and Powerful Parameter Server for large-scale machine learning

Efficient Triton Kernels for LLM Training

Official PyTorch implementation of PTS/PSRN: Fast and efficient symbolic expression discovery through parallelized tree search. Evaluates millions of expressions simultaneously on GPU with automated subtree reuse.

An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

? 「大模型」1小时从0训练26M参数的视觉多模态VLM！? Train a 26M-parameter VLM from scratch in just 1 hours!