AIbase
Home
AI Tutorial

pytorch-transformer-distributed

Public

Distributed training (multi-node) of a Transformer model

collective-communicationdata-parallelismdeep-learningdistributed-data-paralleldistributed-traininggradient-accumulationmachine-learningmodel-parallelismpytorchtutorial
Creat：2023-12-08T08:52:38
Update：2025-03-25T04:53:42
https://www.youtube.com/watch?v=toUSzwR0EV8
89
Stars
1
Stars Increase

Related projects

Tensorflow

deep-learning

An Open Source Machine Learning Framework for Everyone

192719
2年前
+38today

N8n

Hot
ai

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

161403
4年前
+680today

Stable Diffusion Webui

Hot
ai

Stable Diffusion web UI

158833
1年前
+73today

Transformers

Hot
bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

153615
2年前
+136today

30 Seconds Of Code

astro

Coding articles to level up your development skills

125990
8个月前
+35today

D3

chart

Bring data to life with SVG, Canvas and HTML. :bar_chart::chart_with_upwards_trend::tada:

111957
1年前
+36today

Pytorch

Hot
autograd

Tensors and Dynamic neural networks in Python with strong GPU acceleration

95701
8个月前
+88today

Opencv

c-plus-plus

Open Source Computer Vision Library

85202
7年前
+42today

Netdata

alerting

X-Ray Vision for your infrastructure!

76944
8个月前
+31today

Deep Live Cam

Hot
ai

real time face swap and one-click video deepfake with only a single image

76195
10个月前
+63today