Popular GitHub Repositories for Constrained Decoding

LightSeq: A High Performance Library for Sequence Processing and Generation

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding are performed with the kaldi toolkit.

? Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms?

Instant, controllable, local pre-trained AI models in Rust

OpenSPG is a Knowledge Graph Engine developed by Ant Group in collaboration with OpenKG, based on the SPG (Semantic-enhanced Programmable Graph) framework. Core Capabilities: 1) domain model constrained knowledge modeling, 2) facts and logic fused representation, 3) natively support KAG...

Starter-kit to build constrained agents with Nextjs, FastAPI and Langchain

This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

Large-scale LLM inference engine

Fast & Simple Resource-Constrained Learning of Deep Network Structure

Connectionist Temporal Classification (CTC) decoding algorithms: best path, beam search, lexicon search, prefix search, and token passing. Implemented in Python.

EEG Transformer 2.0. i. Convolutional Transformer for EEG Decoding. ii. Novel visualization - Class Activation Topography.

Python re-implementation of the (constrained) spectral clustering algorithms used in Google's speaker diarization papers.

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

This repository contains the implementation of paper Online 3D Bin Packing with Constrained Deep Reinforcement Learning.

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

DGMs for NLP. A roadmap.

Official code base for MinD-Video