Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
-
Updated
Jan 6, 2022 - Python
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
SGDR: Stochastic Gradient Descent with Warm Restarts and Cosine Annealing learning rate schedule engine.
SGDR: Stochastic Gradient Descent with Warm Restarts and Cosine Annealing learning rate schedule engine.
To associate your repository with the warm-restarts topic, visit your repo's landing page and select "manage topics."