prodigyopt

An Adam-like optimizer for neural networks with adaptive estimation of learning rate