Homunculus-Project
PublicLong term project about a custom AI architecture. Consist of cutting-edge technique in machine learning such as Flash-Attention, Group-Query-Attention, ZeRO-Infinity, BitNet, etc.
bitnetdeep-learningflash-attentionjupyter-notebooklarge-language-modelslow-rank-adaptationmachine-learningpythonpytorchpytorch-lightning
Creat：2024-07-23T18:13:53
Update：2025-01-07T09:20:57
7
Stars
0
Stars Increase