Popular GitHub Repositories for Device Collaboration

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A collaboration friendly studio for NeRFs

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

A free and open source, self hosted Ai based live meeting note taker and minutes summary generator that can completely run in your Local device (Mac OS and windows OS Support added. Working on adding linux support soon)

PraisonAI is a production-ready Multi AI Agents framework, designed to create AI Agents to automate and solve problems ranging from simple tasks to complex challenges. It provides a low-code solution to streamline the building and management of multi-agent LLM systems, emphasising simplicity, customisation, and effective human-agent collaboration.

On-device Speech Recognition for Apple Silicon

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Tengine is a lite, high performance, modular inference engine for embedded device

On-device wake word detection powered by deep learning

The best apps in the AI era aren’t solo experiences—they’re collaborative. Liveblocks provides customizable pre?built features to make your product multiplayer, engaging, and AI?ready. All without derailing your roadmap.

The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

A C#/.NET library to run LLM (?LLaMA/LLaVA) on your local device efficiently.

Open-source and local-first Slack and Notion alternative that puts you in control of your data

On-device AI across mobile, embedded and edge for PyTorch

An open source AI wearable device that captures what you say and hear in the real world and then transcribes and stores it on your own server. You can then chat with Adeus using the app, and it will have all the right context about what you want to talk about - a truly personalized, personal AI.

?️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.