useful-whisper-server

Tengine is a lite, high performance, modular inference engine for embedded device

Local LLM Server with NPU Acceleration

World's fastest ANPR / ALPR implementation for CPUs, GPUs, VPUs and NPUs using deep learning (Tensorflow, Tensorflow lite, TensorRT, OpenVX, OpenVINO). Multi-Charset (Latin, Korean, Chinese) & Multi-OS (Jetson, Android, Raspberry Pi, Linux, Windows) & Multi-Arch (ARM, x86).

an edge-real-time anchor-free object detector with decent performance

Efficient Inference of Transformer models

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

LLM SDK for OnnxRuntime GenAI (OGA)

Easy usage of Rockchip's NPUs found in RK3588 and similar chips