Popular GitHub Repositories for Producer Consumer

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Run Mixtral-8x7B models in Colab or consumer desktops

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

Classify Kaggle Consumer Finance Complaints into 11 classes. Build the model with CNN (Convolutional Neural Network) and Word Embeddings on Tensorflow.

Cross platform C++ library focusing on optimized machine translation on the consumer-grade device.

Multimodal Question Answering in the Medical Domain: A summary of Existing Datasets and Systems

Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.

Setup and run a local LLM and Chatbot using consumer grade hardware.

?? toolkit for air-gapped LLMs on consumer-grade hardware

A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna

A repository for generating and training short audio samples with unconditional waveform diffusion on accessible consumer hardware (<2GB VRAM GPU)

A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM

CodeUp: A Multilingual Code Generation Llama-X Model with Parameter-Efficient Instruction-Tuning

Instruct-tune LLaMA on consumer hardware with shareGPT data

LLM Inference on consumer devices

Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA

AI-powered universal search for all your personal data, tailored just for you. Goal:The world's first product with "edge-side LLMs + consumer data localization" as its core development direction.

Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA

Stream processing using kafka-python to track people (user input images of target) in the wild over multiple video streams.

A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca