Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-713

ResourceManager can exit unexpectedly if DNS is unavailable

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.1.0-beta
    • 2.4.0
    • resourcemanager
    • None
    • Reviewed

    Description

      As discussed in MAPREDUCE-5261, there's a possibility that a DNS outage could lead to an unhandled exception in the ResourceManager's AsyncDispatcher, and that ultimately would cause the RM to exit. The RM should not exit during DNS hiccups.

      Attachments

        1. YARN-713.6.patch
          37 kB
          Jian He
        2. YARN-713.5.patch
          37 kB
          Jian He
        3. YARN-713.4.patch
          36 kB
          Jian He
        4. YARN-713.3.patch
          30 kB
          Jian He
        5. YARN-713.2.patch
          86 kB
          Omkar Vinit Joshi
        6. YARN-713.1.patch
          76 kB
          Omkar Vinit Joshi
        7. YARN-713.20130910.1.patch
          80 kB
          Omkar Vinit Joshi
        8. YARN-713.09062013.1.patch
          75 kB
          Omkar Vinit Joshi
        9. YARN-713.09052013.1.patch
          16 kB
          Omkar Vinit Joshi
        10. YARN-713.patch
          22 kB
          Maysam Yabandeh
        11. YARN-713.patch
          22 kB
          Maysam Yabandeh
        12. YARN-713.patch
          4 kB
          Maysam Yabandeh
        13. YARN-713.patch
          5 kB
          Maysam Yabandeh

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. YARN-1417 RM may issue expired container tokens to AM while issuing new containers.

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          breaks

          Bug - A problem which impairs or prevents the functions of the product. YARN-1795 After YARN-713, using FairScheduler can cause an InvalidToken Exception for NMTokens

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. YARN-1694 RM is shutting down when an NM is added to cluster without updating the hostname in /etc/hosts

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-768 RM crashes due to DNS issue

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-1114 Resource Manager Failure Due to Unreachable DNS

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-1894 RM shutdown due to java.net.UnknownHostException

          • Major - Major loss of function.
          • Closed
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. YARN-957 Capacity Scheduler tries to reserve the memory more than what node manager reports.

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-4295 RM crashes due to DNS issue

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Sub-task - The sub-task of the issue YARN-617 In unsercure mode, AM can fake resource requirements

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. YARN-1839 Capacity scheduler preempts an AM out. AM attempt 2 fails to launch task container with SecretManager$InvalidToken: No NMToken sent

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5261 TestRMContainerAllocator is exiting and failing the build

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jianhe Jian He
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: