c4-dataset-script
PublicInspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese data processing and cleaning methods in MassiveText.
Creat:2022-05-27T18:15:11
Update:2025-03-24T14:30:29
129
Stars
0
Stars Increase