Popular GitHub Repositories for Cuda Demo

A high-throughput and memory-efficient inference and serving engine for LLMs

??HivisionIDPhotos: a lightweight and efficient AI ID photos tools. 一个轻量级的AI证件照制作算法。

SGLang is a fast serving framework for large language models and vision language models.

kaldi-asr/kaldi is the official location of the Kaldi project.

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Containers for machine learning

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

CUDA Templates for Linear Algebra Subroutines

Building a quick conversation-based search demo with Lepton AI.

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/

Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, OpenCV Contrib, and OpenVINO.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A flexible framework of neural networks for deep learning

SUPIR aims at developing Practical Algorithms for Photo-Realistic Image Restoration In the Wild. Our new online demo is also released at suppixel.ai.

Curated list of awesome GAN applications and demo

A PyTorch Library for Accelerating 3D Deep Learning Research

cuML - RAPIDS Machine Learning Library