Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10210

Add a RMFailoverProxyProvider that does DNS resolution on failover

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.2
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In Kubernetes, the a node may go down and then come back later with a different IP address. YARN clients which are already running will be unable to rediscover the node after it comes back up due to caching the original IP address. This is problematic for cases such as Spark HA on Kubernetes, as the node containing the resource manager may go down and come back up, meaning existing node managers must then also be restarted.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                roliu Roger Liu
                Reporter:
                roliu Roger Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: