Popular GitHub Repositories for Onnxruntime

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, support 11 programming languages

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

An Engine-Agnostic Deep Learning Framework in Java

? A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. ??

? Accelerate inference and training of ? Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

OpenMMLab Model Deployment Framework

Local AI API Platform

QualityScaler - image/video AI upscaler app

???YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

Lightweight nudity detection

? Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.

Fast ML inference & training for ONNX models in Rust

Realtime human head pose estimation with ONNXRuntime and OpenCV.

支持按轴凹总力战, 无缝制造三解, 用于实现蔚蓝档案自动化的程序

多个SVC/TTS的C++推理库

ONNX Model Exporter for PaddlePaddle

A Redis module for serving tensors and executing deep learning graphs

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Production-ready Inference, Ingestion and Indexing built in Rust ?

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.