flora-opt
PublicThis is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
deep-learningflaxjaxlarge-language-modelsloramemory-efficient-tuningoptaxpeftrandom-projectiontransformers
Creat:2024-02-05T15:01:09
Update:2025-03-04T16:33:04
https://arxiv.org/abs/2402.03293
104
Stars
0
Stars Increase