Simd

ncnn is a high-performance neural network inference framework optimized for the mobile platform

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md)

Open3D: A Modern Library for 3D Data Processing

An open source library for face detection in images. The face detection speed can reach 1000FPS.

?1MB lightweight face detection model (1MB轻量级人脸检测模型)

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, support 11 programming languages

Tengine is a lite, high performance, modular inference engine for embedded device

Fast inference engine for Transformer models

oneAPI Deep Neural Network Library (oneDNN)