AIbase
Home
AI Tutorial

Transformer-Adaptation-Playbook

Public

An empirical study of Transformer adaptation techniques. Pre-training from scratch (MLM), classic fine-tuning, and from-scratch implementations of PEFT methods (LoRA, Adapters). Tuning both encoder (BERT) and decoder (OPT) models.

adaptersbertdeep-learningfine-tuninggptinstruction-tuningloramasked-language-modelingnatural-language-processingpeft
Creat：2025-09-03T15:18:41
Update：2025-09-03T19:00:08
1
Stars
0
Stars Increase

Related projects

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

192719
2年前
+38today

Stable Diffusion Webui

Hot
ai

Stable Diffusion web UI

158833
1年前
+73today

Transformers

Hot
bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

153615
2年前
+136today

30 Seconds Of Code

astro

Coding articles to level up your development skills

125990
8个月前
+35today

Pytorch

Hot
autograd

Tensors and Dynamic neural networks in Python with strong GPU acceleration

95701
8个月前
+88today

Opencv

c-plus-plus

Open Source Computer Vision Library

85202
7年前
+42today

Netdata

alerting

X-Ray Vision for your infrastructure!

76944
8个月前
+31today

Deep Live Cam

Hot
ai

real time face swap and one-click video deepfake with only a single image

76195
10个月前
+63today

D2l Zh

Hot
book

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

74277
8个月前
+60today

Cs Video Courses

Hot
algorithms

List of Computer Science courses with video lectures.

70343
8个月前
+91today