pepy.tech

hetu-galvatron

2.4.0
5.23k

Galvatron, a Efficient Transformer Training Framework for Multiple GPUs Using Automatic Parallelism