Popular GitHub Repositories for Embeddings

The Memory layer for AI Agents

100+ Chinese Word Vectors 上百种预训练中文词向量

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

Retrieval and Retrieval-augmented LLMs

Java version of LangChain

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

Chat with your notes & see links to related content with AI embeddings. Use local models or 100+ via APIs like Claude, Gemini, ChatGPT & Llama 3

A library for transfer learning by reusing parts of TensorFlow models.

A blazing fast inference solution for text embeddings models

A python library for self-supervised learning on images.

? Survey papers summarizing advances in deep learning, NLP, CV, graphs, reinforcement learning, recommendations, graphs, etc.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

An app to interact privately with your documents using the power of GPT, 100% privately, no data leaks

Basic Utilities for PyTorch Natural Language Processing (NLP)

Distributed vector search for AI-native applications

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Documentation for Google's Gen AI site - including the Gemini API and Gemma

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings