Popular GitHub Repositories for Token Extraction

? Easy-to-use and powerful NLP and LLM library with ? Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including ?Text Classification, ? Neural Search, ? Question Answering, ?? Information Extraction, ? Document Intelligence, ? Sentiment Analysis etc.

An open source library for deep learning end-to-end dialog systems and chatbots.

An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

? KIMI AI 长文本大模型逆向API【特长：长文本解读整理】，支持高速流式输出、智能体对话、联网搜索、探索版、K1思考模型、长文档解读、图像解析、多轮对话，零配置部署，多路token支持，自动清理会话痕迹，仅供测试，如需商用请前往官方开放平台。

OpenMMLab Text Detection, Recognition and Understanding Toolbox

⚡️ Python client for the unofficial ChatGPT API with auto token regeneration, conversation tracking, proxy support and more.

农业知识图谱(AgriKG)：农业领域的信息检索，命名实体识别，关系抽取，智能问答，辅助决策

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

State of the Art Natural Language Processing

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

Minimal keyword extraction with BERT

Snips Python library to extract meaning from text

Module for automatic summarization of text documents and HTML pages.

??High-Performance Face Recognition Library on PaddlePaddle & PyTorch??

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Speaker Extraction, etc.

Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

? DeepSeek-V3 R1大模型逆向API【特长：良心厂商】（官方贼便宜，建议直接走官方），支持高速流式输出、多轮对话，联网搜索，R1深度思考，零配置部署，多路token支持，仅供测试，如需商用请前往官方开放平台。