Popular GitHub Repositories for Fract Bits

? Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms?

Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit

CS F425 Deep Learning course at BITS Pilani (Goa Campus)

Training Low-bits DNNs with Stochastic Quantization

Data to bits normalization helpers script to use with neural network(s).

Developing a four-legged Quadruped robot 'DIPLOID' with stable walking by reinforced learning on bezier gait and terrain awareness using SLAM technique as a part of long-term project undertaken by Team Robocon. (2019-present)

A python implementation of Speech intelligibility in bits (SIIB)

LLaMA-BitNet is a repository dedicated to empowering users to train their own BitNet models built upon LLaMA 2 model, inspired by the groundbreaking paper 'The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits'.

In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization aware training of the linear layers and demonstrate the performance for 8 bits, 4 bits, 2 bits and 1 bit (binary) quantization.

The implementatin of our ICLR 2021 work: Targeted Attack against Deep Neural Networks via Flipping Limited Weight Bits

An implementation of Short Horizon Actor Critic writen in Jax. Core algorithm written in the style of Brax, with several bits taken from Xu's original paper.

Imagine every word you speak, every picture you share, and every video you create being used to build something incredible. In the world of AGI, these pieces of information are essential. We call them Julia Photons. They are the bits of data that AGI systems, like Julia, use to understand, learn, and interact with the world around you.

AI Adventure Solver is an AI-powered robot capable to explore and potentially win vintage Text Adventure Games for MSX (8-bits computer). Read the story of this tool: https://gohorse.tech/they-said-ai-can-run-a-business-but-it-failed-to-beat-this-old-8-bit-game

This repo is based on the project "Scheduler for LLM Interfacing", a part of DaSHLab, BITS Goa.