iAI

A high-throughput and memory-efficient inference and serving engine for LLMs

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

SGLang is a fast serving framework for large language models and vision language models.

kaldi-asr/kaldi is the official location of the Kaldi project.

Open3D: A Modern Library for 3D Data Processing

人工智能学习路线图，整理近200个实战案例与项目，免费提供配套教材，零基础入门，就业实战！包括：Python，数学，机器学习，数据分析，深度学习，计算机视觉，自然语言处理，PyTorch tensorflow machine-learning,deep-learning data-analysis data-mining mathematics data-science artificial-intelligence python tensorflow tensorflow2 caffe keras pytorch algorithm numpy pandas matplotlib seaborn nlp cv等热门领域

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.

NumPy aware dynamic Python compiler using LLVM