Popular GitHub Repositories for Android Device

? Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Cross-platform, customizable ML solutions for live and streaming media.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Filament是一个实时物理渲染引擎，支持Android、iOS、Windows、Linux、macOS和WebGL2平台。

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md)

fay是一个帮助数字人（2.5d、3d、移动、pc、网页）或大语言模型（openai兼容、deepseek）连通业务系统的agent框架。

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, support 11 programming languages

A free and open source, self hosted Ai based live meeting note taker and minutes summary generator that can completely run in your Local device (Mac OS and windows OS Support added. Working on adding linux support soon)

Flower: A Friendly Federated AI Framework

NanoDet-Plus?Super fast and lightweight anchor-free object detection model. ?Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone?

High Performance Chinese License Plate Recognition Framework.

On-device Speech Recognition for Apple Silicon

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Tengine is a lite, high performance, modular inference engine for embedded device

On-device wake word detection powered by deep learning

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.