Popular GitHub Repositories for Gpu Mode

Tensors and Dynamic neural networks in Python with strong GPU acceleration

ComfyUI docker images for use in GPU cloud and local environments. Includes AI-Dock base for authentication and improved user experience.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

The fastai deep learning library

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

A WebGL accelerated JavaScript library for training and deploying ML models.

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

? GPU accelerated Neural networks in JavaScript for Browsers and Node.js

Open deep learning compiler stack for cpu, gpu and specialized accelerators

NVIDIA? TensorRT? is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

This is a collection of tutorials for learning how to use Docker with various tools. Contributions welcome.

An open-source, low-code machine learning library in Python

Running large language models on a single GPU for throughput-oriented scenarios.

A python library built to empower developers to build applications and systems with self-contained Computer Vision capabilities

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

CUDA Templates for Linear Algebra Subroutines