TrackNetV3

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

NVIDIA? TensorRT? is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

BoxMOT: pluggable SOTA tracking modules for segmentation, object detection and pose estimation models

Lossy PNG compressor — pngquant command based on libimagequant library

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

An easy to use PyTorch to TensorRT converter

?A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, Flash-Attention, Paged-Attention, Parallelism, etc. ??