gradio-litserve-runpod-deployment-template

A high-throughput and memory-efficient inference and serving engine for LLMs

Curso para aprender el lenguaje de programación Python desde cero y para principiantes. 100 clases, 44 horas en vídeo, código, proyectos y grupo de chat. Fundamentos, frontend, backend, testing, IA...

?? Build multimodal AI applications with cloud-native stack

??HivisionIDPhotos: a lightweight and efficient AI ID photos tools. 一个轻量级的AI证件照制作算法。

SGLang is a fast serving framework for large language models and vision language models.

kaldi-asr/kaldi is the official location of the Kaldi project.

Open3D: A Modern Library for 3D Data Processing

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.

NumPy aware dynamic Python compiler using LLVM

NumPy & SciPy for GPU