Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1994

Expose YARN/MR endpoints on multiple interfaces

    XMLWordPrintableJSON

Details

    Description

      YARN and MapReduce daemons currently do not support specifying a wildcard address for the server endpoints. This prevents the endpoints from being accessible from all interfaces on a multihomed machine.

      Note that if we do specify INADDR_ANY for any of the options, it will break clients as they will attempt to connect to 0.0.0.0. We need a solution that allows specifying a hostname or IP-address for clients while requesting wildcard bind for the servers.

      (List of endpoints is in a comment below)

      Attachments

        1. YARN-1994.0.patch
          38 kB
          Craig Welch
        2. YARN-1994.1.patch
          40 kB
          Craig Welch
        3. YARN-1994.11.patch
          48 kB
          Craig Welch
        4. YARN-1994.11.patch
          48 kB
          Craig Welch
        5. YARN-1994.12.patch
          47 kB
          Craig Welch
        6. YARN-1994.13.patch
          59 kB
          Craig Welch
        7. YARN-1994.14.patch
          53 kB
          Craig Welch
        8. YARN-1994.15.patch
          54 kB
          Craig Welch
        9. YARN-1994.15-branch2.patch
          53 kB
          Craig Welch
        10. YARN-1994.2.patch
          40 kB
          Craig Welch
        11. YARN-1994.3.patch
          43 kB
          Craig Welch
        12. YARN-1994.4.patch
          47 kB
          Milan Potocnik
        13. YARN-1994.5.patch
          47 kB
          Milan Potocnik
        14. YARN-1994.6.patch
          62 kB
          Craig Welch
        15. YARN-1994.7.patch
          48 kB
          Craig Welch

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. YARN-800 Clicking on an AM link for a running app leads to a HTTP 500

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-5128 Allow multiple net interfaces to be used with HA namenode RPC server

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-6273 Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-2384 Document YARN multihoming settings

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HDFS-6712 Document HDFS Multihoming Settings

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6019 MapReduce changes for exposing YARN/MR endpoints on multiple interfaces.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cwelch Craig Welch
              arp Arpit Agarwal
              Votes:
              1 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: