Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8333

Load balance YARN services using RegistryDNS multiple A records

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.2.0, 3.1.1
    • Component/s: yarn-native-services
    • Labels:
      None

      Description

      For scaling stateless containers, it would be great to support DNS round robin for fault tolerance and load balancing. The current DNS record format for RegistryDNS is [container-instance].[application-name].[username].[domain]. For example:

      appcatalog-0.appname.hbase.ycluster. IN A 123.123.123.120
      appcatalog-1.appname.hbase.ycluster. IN A 123.123.123.121
      appcatalog-2.appname.hbase.ycluster. IN A 123.123.123.122
      appcatalog-3.appname.hbase.ycluster. IN A 123.123.123.123
      

      It would be nice to add multi-A record that contains all IP addresses of the same component in addition to the instance based records. For example:

      appcatalog.appname.hbase.ycluster. IN A 123.123.123.120
      appcatalog.appname.hbase.ycluster. IN A 123.123.123.121
      appcatalog.appname.hbase.ycluster. IN A 123.123.123.122
      appcatalog.appname.hbase.ycluster. IN A 123.123.123.123
      

        Attachments

        1. YARN-8333.001.patch
          9 kB
          Eric Yang
        2. YARN-8333.002.patch
          9 kB
          Eric Yang
        3. YARN-8333.003.patch
          11 kB
          Eric Yang

          Activity

            People

            • Assignee:
              eyang Eric Yang
              Reporter:
              eyang Eric Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: