Popular GitHub Repositories for Bookcorpus

Embedding模型代码和学习笔记总结

Trained Decoder only model on large BookCorpus Dataset. First time!

BioMedical Language Processing with ELECTRA

A 354M parameter GPT-2 model trained on filtered Wikipedia, BookCorpus, and OpenWebText. Includes 4-bit quantized version for lightweight inference. Built as a toy project to explore end-to-end LLM training using Hugging Face.