Popular GitHub Repositories for Subword Embeddings

The Memory layer for AI Agents

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

the AI-native open-source embedding database

100+ Chinese Word Vectors 上百种预训练中文词向量

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

? All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

Retrieval and Retrieval-augmented LLMs

Java version of LangChain

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Postgres with GPUs for ML/AI apps.

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

Chat with your notes & see links to related content with AI embeddings. Use local models or 100+ via APIs like Claude, Gemini, ChatGPT & Llama 3

A blazing fast inference solution for text embeddings models

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

A library for transfer learning by reusing parts of TensorFlow models.

A python library for self-supervised learning on images.

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.