Popular GitHub Repositories for Device Pairing

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A free and open source, self hosted Ai based live meeting note taker and minutes summary generator that can completely run in your Local device (Mac OS and windows OS Support added. Working on adding linux support soon)

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

On-device Speech Recognition for Apple Silicon

RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

On-device wake word detection powered by deep learning

Tengine is a lite, high performance, modular inference engine for embedded device

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

On-device AI across mobile, embedded and edge for PyTorch

Ollama but for Mobile ?

A C#/.NET library to run LLM (?LLaMA/LLaVA) on your local device efficiently.

An open source AI wearable device that captures what you say and hear in the real world and then transcribes and stores it on your own server. You can then chat with Adeus using the app, and it will have all the right context about what you want to talk about - a truly personalized, personal AI.

A Curated list of IoT Security Resources

? Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms?

A modern, web-based photo management server. Run it on your home server and it will let you find the right photo from your collection on any device. Smart filtering is made possible by object recognition, face recognition, location awareness, color analysis and other ML algorithms.

An Embedded Computer Vision & Machine Learning Library (CPU Optimized & IoT Capable)

Lightning-fast, on-device TTS — running natively via ONNX.

This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.