Popular GitHub Repositories for Speed

An open source library for face detection in images. The face detection speed can reach 1000FPS.

High-speed Large Language Model Serving for Local Deployment

Trax — Deep Learning with Clear Code and Speed

Alluxio, data orchestration for analytics and machine learning in the cloud

A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility

notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.

JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

LightGlue: Local Feature Matching at Light Speed (ICCV 2023)

Supercharge Your LLM with the Fastest KV Cache Layer

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

IDA plugin which queries language models to speed up reverse-engineering

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

Instant-ngp in pytorch+cuda trained with pytorch-lightning (high quality with high speed, with only few lines of legible code)

YOLOv8 Object Tracking using PyTorch, OpenCV and DeepSORT

:oncoming_automobile: "MORE THAN VEHICLE COUNTING!" This project provides prediction for speed, color and size of the vehicles with TensorFlow Object Counting API.

Fast and accurate face landmark detection library using PyTorch; Support 68-point semi-frontal and 39-point profile landmark detection; Support both coordinate-based and heatmap-based inference; Up to 100 FPS landmark inference speed with SOTA face detector on CPU.

The online version is temporarily unavailable because we cannot afford the key. You can clone and run it locally. Note: we set defaul openai key. If keys exceed plan and are invalid, please tell us. The response speed depends on openai. ( sometimes, the official is too crowded and slow)

? Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.

This project accelerates CNN computation with the help of FPGA, for more than 50x speed-up compared with CPU.

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.