Popular GitHub Repositories for Sentence Embeddings

The Memory layer for AI Agents

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

the AI-native open-source embedding database

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

100+ Chinese Word Vectors 上百种预训练中文词向量

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

? All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

Retrieval and Retrieval-augmented LLMs

CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.

Java version of LangChain

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Postgres with GPUs for ML/AI apps.

Venom is a high-performance system developed with JavaScript to create a bot for WhatsApp, support for creating any interaction, such as customer service, media sending, sentence recognition based on artificial intelligence and all types of design architecture for WhatsApp.

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation