Popular GitHub Repositories for Earley Parser

中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理

File Parser optimised for LLM Ingestion with no loss ? Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

A Unified Toolkit for Deep Learning Based Document Image Analysis

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

Snips Python library to extract meaning from text

A Repo For Document AI

Deep neural network to extract intelligent information from invoice documents.

文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法

A python module to repair invalid JSON from LLMs

A machine learning toolkit for log parsing [ICSE'19, DSN'16]

Microsoft.Recognizers.Text provides recognition and resolution of numbers, units, date/time, etc. in multiple languages (ZH, EN, FR, ES, PT, DE, IT, TR, HI, NL. Partial support for JA, KO, AR, SV). Packages available at: https://www.nuget.org/profiles/Recognizers.Text, https://www.npmjs.com/~recognizers.text

Underthesea - Vietnamese NLP Toolkit

Open-source platform for extracting structured data from documents using AI.

Persian NLP Toolkit

High-accuracy NLP parser with models for 11 languages.

An Agnostic Computer Vision Framework - Pluggable to any Training Library: Fastai, Pytorch-Lightning with more to come

fastHan是基于fastNLP与pytorch实现的中文自然语言处理工具，像spacy一样调用方便。

Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources

Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing