AIbase

Large-Language-Models-on-Supercomputers

Public

Comprehensive exploration of LLMs, including cutting-edge techniques and tools such as parameter-efficient fine-tuning (PEFT), quantization, zero redundancy optimizers (ZeRO), fully sharded data parallelism (FSDP), DeepSpeed, and Huggingface accelerate.

Creat2024-09-26T17:08:32
Update2024-11-08T07:42:01
0
Stars
0
Stars Increase

Related projects