EDE

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

搜索所有中文NLP数据集，附常用英文NLP数据集

百度NLP：分词，词性标注，命名实体识别，词重要性

Module for automatic summarization of text documents and HTML pages.

AdalFlow: The library to build & auto-optimize LLM applications.

AI constraint solver in Java to optimize the vehicle routing problem, employee rostering, task assignment, maintenance scheduling, conference scheduling and other planning problems.

LightSeq: A High Performance Library for Sequence Processing and Generation

An open-source data logging library for machine learning models and data pipelines. ? Provides visibility into data quality & model performance over time. ?️ Supports privacy-preserving data collection, ensuring safety & robustness. ?

文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法

A modular RL library to fine-tune language models to human preferences