Uploaded image for project: 'Apache MXNet'
  1. Apache MXNet
  2. MXNET-1420

Implement RAdam

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: To Do
    • Priority: Major
    • Resolution: Unresolved
    • Component/s: Apache MXNet Backend, Gluon
    • Labels:
      None

      Description

      Implementation of RAdam optimizer based on the new paperĀ [ON THE VARIANCE OF THE ADAPTIVE LEARNING RATE AND BEYOND|https://arxiv.org/pdf/1908.03265v1.pdf]

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              McDhee Dheeraj M
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: