pepy.tech

hetu-galvatron

2.4.0
5.54k

Galvatron, a Efficient Transformer Training Framework for Multiple GPUs Using Automatic Parallelism