Popular GitHub Repositories for Compress

? Must-read papers and blogs on LLM based Long Context Modeling ?

Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.

Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of GPT-Fast, a simple, PyTorch-native generation codebase.

[ICML 2020] "AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks" by Yonggan Fu, Wuyang Chen, Haotao Wang, Haoran Li, Yingyan (Celine) Lin, and Zhangyang (Atlas) Wang.

Cloud-Native PostgreSQL WAL receiver. Stream, compress, encrypt, upload, retain and monitor your WAL archive.

Compress the HTML as much as possible for LLM to inference.

Zip Prompt Language - compress heavy system prompts by ≥ 80 % token reduction

An MCP tool that provides AI with the ability to compress and decompress local files.

Embedding Quantization (Compress Word Embeddings)

Compress, Deploy and Inference YOLOv7 on low-cost MCUs

Dive into advanced quantization techniques. Learn to implement and customize linear quantization functions, measure quantization error, and compress model weights using PyTorch for efficient and accessible AI models.

Learn linear quantization techniques using the Quanto library and downcasting methods with the Transformers library to compress and optimize generative AI models effectively.

Picsart Creative APIs SDK for Python. Includes helper methods and functions for Programmable Image APIs (e.g. Remove Background, Upscale, Enhance, Effects) and the GenAI APIs (e.g. Text2Image, Replace, Expand Image).

Stages blog posts, has C++ sources which match posts. Blog is about antivirus + autonomous tools + calculus of neural tissues

反病毒软件的C++库 + 神经网络模块（例如助手使用的模块）+ 通用数据结构。`/bin/sh` 命令行工具库。关于自主工具的Markdown文章。

Project based on our research work titled "A Light-Weight Image to Description Model Using Knowledge Distillation". We performed knowledge distillation to compress the pre-trained llama 2-7b model into our 247M parameter model. Combined it with BLIP captioning model to create an image to description model. Finally integrated it with flutter app.

I ♥ PDF Toolkit is a lightweight desktop application built with Python and Tkinter that provides essential tools for working with PDFs and images — all in one place. Whether you need to compress, merge, convert, or extract text using OCR, this toolkit offers a simple and multilingual interface with drag-and-drop support, night mode, and offline fun