Details
-
Improvement
-
Status: To Do
-
Minor
-
Resolution: Unresolved
-
None
-
None
Description
First tutorial is on learning rate schedules inĀ mxnet.lr_scheduler, how to use them with Optimizer and Trainer in Gluon and how to implement a custom learning rate schedule. Contains visualizations of the schedules.
Second tutorial shows how to use common learning rate schedules such as Cyclical schedules, SDG with Restarts, Warm-up and Cool-down. Many paper references are provided. Contains visualizations of the schedules.
Added to tutorial testing and index page.
Attachments
Issue Links
- links to