Popular GitHub Repositories for Langauge

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

[COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

Traditional Mandarin LLMs for Taiwan

Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".

GUICourse: From General Vision Langauge Models to Versatile GUI Agents

Natural Language Processing (NLP). Covering topics such as Tokenization, Part Of Speech tagging (POS), Machine translation, Named Entity Recognition (NER), Classification, and Sentiment analysis.

Tensorflow implementation of Semi-supervised Sequence Learning (https://arxiv.org/abs/1511.01432)

NLP basic and advance text preprocessing concepts and techniques

The goal of this script is to implement three langauge models to perform sentence completion, i.e. given a sentence with a missing word to choose the correct one from a list of candidate words. The way to use a language model for this problem is to consider a possible candidate word for the sentence at a time and then ask the language model which version of the sentence is the most probable one.

A natural language processing and machine learning project for a low resource langauge in Zambia.

Mélodium 是一种面向流的语言，专注于事件和处理，能够安全地实现强大的可扩展性和并行化。

Implementation of a LLaDA-inspired Masked Diffusion Model for Text using PURE BYTE-LEVEL TOKENIZATION (cuz why not) and Mixed Precision Training for speed.

A Guide to Help Teach the Fundamentals of Responsible AI

Lexical to semantic space mapping for language learning.