Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-713

ResourceManager can exit unexpectedly if DNS is unavailable

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.1.0-beta
    • 2.4.0
    • resourcemanager
    • None
    • Reviewed

    Description

      As discussed in MAPREDUCE-5261, there's a possibility that a DNS outage could lead to an unhandled exception in the ResourceManager's AsyncDispatcher, and that ultimately would cause the RM to exit. The RM should not exit during DNS hiccups.

      Attachments

        1. YARN-713.patch
          5 kB
          Maysam Yabandeh
        2. YARN-713.patch
          4 kB
          Maysam Yabandeh
        3. YARN-713.patch
          22 kB
          Maysam Yabandeh
        4. YARN-713.patch
          22 kB
          Maysam Yabandeh
        5. YARN-713.09052013.1.patch
          16 kB
          Omkar Vinit Joshi
        6. YARN-713.09062013.1.patch
          75 kB
          Omkar Vinit Joshi
        7. YARN-713.20130910.1.patch
          80 kB
          Omkar Vinit Joshi
        8. YARN-713.1.patch
          76 kB
          Omkar Vinit Joshi
        9. YARN-713.2.patch
          86 kB
          Omkar Vinit Joshi
        10. YARN-713.3.patch
          30 kB
          Jian He
        11. YARN-713.4.patch
          36 kB
          Jian He
        12. YARN-713.5.patch
          37 kB
          Jian He
        13. YARN-713.6.patch
          37 kB
          Jian He

        Issue Links

        blocks

        Bug - A problem which impairs or prevents the functions of the product. YARN-1417 RM may issue expired container tokens to AM while issuing new containers.

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed
        breaks

        Bug - A problem which impairs or prevents the functions of the product. YARN-1795 After YARN-713, using FairScheduler can cause an InvalidToken Exception for NMTokens

        • Blocker - Blocks development and/or testing work, production could not run
        • Resolved
        duplicates

        Bug - A problem which impairs or prevents the functions of the product. YARN-1694 RM is shutting down when an NM is added to cluster without updating the hostname in /etc/hosts

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. YARN-768 RM crashes due to DNS issue

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. YARN-1114 Resource Manager Failure Due to Unreachable DNS

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. YARN-1894 RM shutdown due to java.net.UnknownHostException

        • Major - Major loss of function.
        • Closed
        is blocked by

        Bug - A problem which impairs or prevents the functions of the product. YARN-957 Capacity Scheduler tries to reserve the memory more than what node manager reports.

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed
        is related to

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-4295 RM crashes due to DNS issue

        • Critical - Crashes, loss of data, severe memory leak.
        • Closed
        relates to

        Sub-task - The sub-task of the issue YARN-617 In unsercure mode, AM can fake resource requirements

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. YARN-1839 Capacity scheduler preempts an AM out. AM attempt 2 fails to launch task container with SecretManager$InvalidToken: No NMToken sent

        • Critical - Crashes, loss of data, severe memory leak.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5261 TestRMContainerAllocator is exiting and failing the build

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jianhe Jian He
            jlowe Jason Darrell Lowe
            Votes:
            0 Vote for this issue
            Watchers:
            19 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment