Details
-
Improvement
-
Status: To Do
-
Minor
-
Resolution: Unresolved
-
None
-
None
Description
Added tutorial that demonstrates a method of finding a good initial starting learning rate.
Method from "Cyclical Learning Rates for Training Neural Networks" by Leslie N. Smith (2015). And seen in many blog posts (e.g. https://towardsdatascience.com/estimating-optimal-learning-rate-for-a-deep-neural-network-ce32f2556ce0).
Attachments
Issue Links
- links to
