Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10479

RMProxy should retry on SocketTimeout Exceptions

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.10.1, 3.4.0
    • 3.2.2, 3.4.0, 3.3.1, 2.10.2
    • yarn
    • None

    Description

      During an incident involving a DNS outage, a large number of nodemanagers failed to come back into service because they hit a socket timeout when trying to re-register with the RM.

      SocketTimeoutException is not currently one of the exceptions that the RMProxy will retry. Based on this incident, it seems like it should be. We made this change internally about a year ago and it has been running in production since.

      Attachments

        1. YARN-10479.001.patch
          1 kB
          Jim Brennan
        2. YARN-10479.002.patch
          6 kB
          Jim Brennan
        3. YARN-10479.003.patch
          6 kB
          Jim Brennan

        Activity

          People

            jbrennan Jim Brennan
            jbrennan Jim Brennan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: