Popular GitHub Repositories for Device

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A free and open source, self hosted Ai based live meeting note taker and minutes summary generator that can completely run in your Local device (Mac OS and windows OS Support added. Working on adding linux support soon)

On-device Speech Recognition for Apple Silicon

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Tengine is a lite, high performance, modular inference engine for embedded device

On-device wake word detection powered by deep learning

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

A C#/.NET library to run LLM (?LLaMA/LLaVA) on your local device efficiently.

On-device AI across mobile, embedded and edge for PyTorch

An open source AI wearable device that captures what you say and hear in the real world and then transcribes and stores it on your own server. You can then chat with Adeus using the app, and it will have all the right context about what you want to talk about - a truly personalized, personal AI.

A Curated list of IoT Security Resources

? Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms?

A modern, web-based photo management server. Run it on your home server and it will let you find the right photo from your collection on any device. Smart filtering is made possible by object recognition, face recognition, location awareness, color analysis and other ML algorithms.

An Embedded Computer Vision & Machine Learning Library (CPU Optimized & IoT Capable)

This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.

[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Awesome LLMs on Device: A Comprehensive Survey

Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"