Popular GitHub Repositories for Information Bottleneck

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.

DocsGPT is an open-source genAI tool that helps users get reliable answers from knowledge source, while avoiding hallucinations. It enables private and reliable information retrieval, with tooling and agentic system capability built in.

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database?.

Creative Coding: Generative Art, Data visualization, Interaction Design, Resources.

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

? Easy-to-use and powerful NLP and LLM library with ? Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including ?Text Classification, ? Neural Search, ? Question Answering, ?? Information Extraction, ? Document Intelligence, ? Sentiment Analysis etc.

? All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

Retrieval and Retrieval-augmented LLMs

Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet and cites it too. Powered by Vercel AI SDK! Search with models like xAI's Grok 3.

MCP server to provide Figma layout information to AI coding agents like Cursor

Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.

Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai

OpenMMLab Text Detection, Recognition and Understanding Toolbox

A machine learning software for extracting information from scholarly documents

Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

Snips Python library to extract meaning from text