Popular GitHub Repositories for Cuda Q

A high-throughput and memory-efficient inference and serving engine for LLMs

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

SGLang is a fast serving framework for large language models and vision language models.

kaldi-asr/kaldi is the official location of the Kaldi project.

强化学习中文教程（蘑菇书?），在线阅读地址：https://datawhalechina.github.io/easy-rl/

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.

Simple Reinforcement learning tutorials, 莫烦Python 中文AI教学

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Containers for machine learning

CUDA Templates for Linear Algebra Subroutines

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, OpenCV Contrib, and OpenVINO.

Flappy Bird hack using Deep Reinforcement Learning (Deep Q-learning).

Supercharge Your LLM with the Fastest KV Cache Layer

A flexible framework of neural networks for deep learning

cuML - RAPIDS Machine Learning Library