pepy.tech

hetu-galvatron

2.4.0
6.80k

Galvatron, a Efficient Transformer Training Framework for Multiple GPUs Using Automatic Parallelism