Popular GitHub Repositories for Bitnet

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

0??1??? BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.

BitNet.js：微软bitnet.cpp推理框架的Node.js实现。

LLaMA-BitNet is a repository dedicated to empowering users to train their own BitNet models built upon LLaMA 2 model, inspired by the groundbreaking paper 'The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits'.

Rust bindings for bitnet.cpp based on llama-cpp-4

Long term project about a custom AI architecture. Consist of cutting-edge technique in machine learning such as Flash-Attention, Group-Query-Attention, ZeRO-Infinity, BitNet, etc.

Bitnet 1.58b: This project implements the innovative 1-bit LLM architecture described in recent whitepapers, focusing on efficient training, inference, and open-source collaboration.

Distily: Language Model Distillation Toolkit and Library

Transformer Bitnet en Verilog

This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.

A powerful and efficient AI virtual co-worker framework built on top of BitNet's 1-bit quantized language models.