Popular GitHub Repositories for Ngram

Four word embedding models implemented in Python. Supporting arbitrary context features

A Lite Bert For Self-Supervised Learning Language Representations

Next-token prediction in JavaScript — build fast language and diffusion models.

Python implementation of an N-gram language model with Laplace smoothing and sentence generation.

A library & tools to evaluate predictive language models.

Python library for extracting quantitative, reproducible metrics of multi-level alignment between speakers in naturalistic language corpora.

Next Word Prediction using n-gram Probabilistic Model with various Smoothing Techniques

利用传统方法（N-gram，HMM等）、神经网络方法（CNN，LSTM等）和预训练方法（Bert等）的中文分词任务实现【The word segmentation task is realized by using traditional methods (n-gram, HMM, etc.), neural network methods (CNN, LSTM, etc.) and pre training methods (Bert, etc.)】

multiprocess unsupervised chinese_detect_words ngram_combination

Accurate, fast, lightweight, multilingual, free and open-source next word prediction library

Language modeling based on ngrams models and smoothing techniques

Neural ngram language model in PyTorch.

The examples I prepared and brought together about the natural language processing topics I learned.

Semantic role labeling with subwords (character, character-ngram and morphology)

A web service that exposes semantic similarity search via a web GUI and a RESTful API.

A Go n-gram indexer for natural language processing with modular tokenizers and data stores

Сравнение нескольких способов представления слов для построения языковых моделей

Add n-gram and LLM language model support to HF Transformers Whisper models.

NLP and Ngram-based text classification system

All NLP related courses on DataCamp