Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1183

MiniYARNCluster shutdown takes several minutes intermittently

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.3.0
    • Component/s: None
    • Labels:
      None

      Description

      As described in MAPREDUCE-5501 sometimes M/R tests leave MRAppMaster java processes living for several minutes after successful completion of the corresponding test. There is a concurrency issue in MiniYARNCluster shutdown logic which leads to this. Sometimes RM stops before an app master sends it's last report, and then the app master keeps retrying for >6 minutes. In some cases it leads to failures in subsequent tests, and it affects performance of tests as app masters eat resources.

        Attachments

        1. YARN-1183.patch
          5 kB
          Andrey Klochkov
        2. YARN-1183--n2.patch
          4 kB
          Andrey Klochkov
        3. YARN-1183--n3.patch
          5 kB
          Andrey Klochkov
        4. YARN-1183--n4.patch
          5 kB
          Andrey Klochkov
        5. YARN-1183--n5.patch
          4 kB
          Andrey Klochkov

          Issue Links

            Activity

              People

              • Assignee:
                aklochkov Andrey Klochkov
                Reporter:
                aklochkov Andrey Klochkov
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: