AIbase
Home

BERT-Multitask-learning

Public

Multitask-learning of a BERT backbone. Allows to easily train a BERT model with state-of-the-art method such as PCGrad, Gradient Vaccine, PALs, Scheduling, Class imbalance handling and many optimizations

bertcs224nmultitask-learningnatural-language-processingprojected-attention-layers
Creat：2023-02-22T11:31:03
Update：2025-01-25T00:32:53
19
Stars
0
Stars Increase

Related projects

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

192719
3年前
+38today

N8n

Hot
ai

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

161403
5年前
+680today

Stable Diffusion Webui

Hot
ai

Stable Diffusion web UI

158833
2年前
+73today

Transformers

Hot
bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

153615
3年前
+136today

30 Seconds Of Code

astro

Coding articles to level up your development skills

125990
1年前
+35today

Pytorch

Hot
autograd

Tensors and Dynamic neural networks in Python with strong GPU acceleration

95701
1年前
+88today

Opencv

c-plus-plus

Open Source Computer Vision Library

85202
8年前
+42today

Netdata

alerting

X-Ray Vision for your infrastructure!

76944
1年前
+31today

D2l Zh

Hot
book

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

74277
1年前
+60today

Cs Video Courses

Hot
algorithms

List of Computer Science courses with video lectures.

70343
1年前
+91today