Popular GitHub Repositories for Consumer Rights

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

A AI-Driven, Distributed and high-performance monitoring system, for comprehensive monitoring and management of kafka cluster.

Run Mixtral-8x7B models in Colab or consumer desktops

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

Enterprise-grade and API-first LLM workspace for unstructured documents, including data extraction, redaction, rights management, prompt playground, and more!

Classify Kaggle Consumer Finance Complaints into 11 classes. Build the model with CNN (Convolutional Neural Network) and Word Embeddings on Tensorflow.

Cross platform C++ library focusing on optimized machine translation on the consumer-grade device.

Multimodal Question Answering in the Medical Domain: A summary of Existing Datasets and Systems

Setup and run a local LLM and Chatbot using consumer grade hardware.

Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.

?? toolkit for air-gapped LLMs on consumer-grade hardware

A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna

A repository for generating and training short audio samples with unconditional waveform diffusion on accessible consumer hardware (<2GB VRAM GPU)

A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM

CodeUp: A Multilingual Code Generation Llama-X Model with Parameter-Efficient Instruction-Tuning

Instruct-tune LLaMA on consumer hardware with shareGPT data

LLM Inference on consumer devices

AI-powered universal search for all your personal data, tailored just for you. Goal:The world's first product with "edge-side LLMs + consumer data localization" as its core development direction.

Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA

Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA