Popular GitHub Repositories for Gpu Memory

ComfyUI docker images for use in GPU cloud and local environments. Includes AI-Dock base for authentication and improved user experience.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

A high-throughput and memory-efficient inference and serving engine for LLMs

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

The Memory layer for AI Agents

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Agno is a lightweight library for building Multimodal Agents. It exposes LLMs as a unified API and gives them superpowers like memory, knowledge, tools and reasoning.

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

The fastai deep learning library

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.

A WebGL accelerated JavaScript library for training and deploying ML models.

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

? GPU accelerated Neural networks in JavaScript for Browsers and Node.js

Open deep learning compiler stack for cpu, gpu and specialized accelerators

NVIDIA? TensorRT? is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

Video-based AI memory library. Store millions of text chunks in MP4 files with lightning-fast semantic search. No database needed.