Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1183

MiniYARNCluster shutdown takes several minutes intermittently

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      As described in MAPREDUCE-5501 sometimes M/R tests leave MRAppMaster java processes living for several minutes after successful completion of the corresponding test. There is a concurrency issue in MiniYARNCluster shutdown logic which leads to this. Sometimes RM stops before an app master sends it's last report, and then the app master keeps retrying for >6 minutes. In some cases it leads to failures in subsequent tests, and it affects performance of tests as app masters eat resources.

      Attachments

        1. YARN-1183--n5.patch
          4 kB
          Andrey Klochkov
        2. YARN-1183--n4.patch
          5 kB
          Andrey Klochkov
        3. YARN-1183--n3.patch
          5 kB
          Andrey Klochkov
        4. YARN-1183--n2.patch
          4 kB
          Andrey Klochkov
        5. YARN-1183.patch
          5 kB
          Andrey Klochkov

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            aklochkov Andrey Klochkov
            aklochkov Andrey Klochkov
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment