Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1183

MiniYARNCluster shutdown takes several minutes intermittently

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      As described in MAPREDUCE-5501 sometimes M/R tests leave MRAppMaster java processes living for several minutes after successful completion of the corresponding test. There is a concurrency issue in MiniYARNCluster shutdown logic which leads to this. Sometimes RM stops before an app master sends it's last report, and then the app master keeps retrying for >6 minutes. In some cases it leads to failures in subsequent tests, and it affects performance of tests as app masters eat resources.

      Attachments

        1. YARN-1183.patch
          5 kB
          Andrey Klochkov
        2. YARN-1183--n2.patch
          4 kB
          Andrey Klochkov
        3. YARN-1183--n3.patch
          5 kB
          Andrey Klochkov
        4. YARN-1183--n4.patch
          5 kB
          Andrey Klochkov
        5. YARN-1183--n5.patch
          4 kB
          Andrey Klochkov

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5501 RMContainer Allocator does not stop when cluster shutdown is performed in tests

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              aklochkov Andrey Klochkov
              aklochkov Andrey Klochkov
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: