docker-mycroft

A high-throughput and memory-efficient inference and serving engine for LLMs

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, support 11 programming languages

Tengine is a lite, high performance, modular inference engine for embedded device

Low-latency machine code generation

oneAPI Deep Neural Network Library (oneDNN)

Fast and lightweight x86/x86-64 disassembler and code generation library

Supercharge Your LLM with the Fastest KV Cache Layer

??? Dynamic DNS (DDNS) service based on Cloudflare! Access your home network remotely via a custom domain name without a static IP!

The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.