Popular GitHub Repositories for Faster Kan

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

Making large AI models cheaper, faster and more accessible

OpenMMLab Detection Toolbox and Benchmark

Faster Whisper transcription with CTranslate2

Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.

A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

? Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Intelligent (edge and LLM) proxy for agents. Move faster by letting Arch handle the pesky heavy lifting in building agentic apps. Fast ?? task clarification, agent routing, seamless integration of prompts with tools for common tasks, and unified access and observability of LLMs.

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

Tensorflow Faster RCNN for Object Detection

Hummingbird compiles trained ML models into tensor computation for faster inference.

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

faster_whisper GUI with PySide6

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.

An AI-powered data science team of agents to help you perform common data science tasks 10X faster.

Jupyter extensions that help you write code faster: Context aware AI Chat, Autocomplete, and Spreadsheet

Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)