Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-71

Ensure/confirm that the NodeManager cleans up local-dirs on restart

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.1.0-beta, 0.23.8
    • nodemanager
    • None
    • Reviewed

    Description

      We have to make sure that NodeManagers cleanup their local files on restart.

      It may already be working like that in which case we should have tests validating this.

      Attachments

        1. YARN.71.4.patch
          8 kB
          Xuan Gong
        2. YARN-71.1.patch
          5 kB
          Xuan Gong
        3. YARN-71.10.patch
          21 kB
          Xuan Gong
        4. YARN-71.11.patch
          21 kB
          Xuan Gong
        5. YARN-71.12.patch
          18 kB
          Xuan Gong
        6. YARN-71.13.patch
          19 kB
          Xuan Gong
        7. YARN-71.2.patch
          8 kB
          Xuan Gong
        8. YARN-71.3.patch
          8 kB
          Xuan Gong
        9. YARN-71.5.patch
          9 kB
          Xuan Gong
        10. YARN-71.6.patch
          9 kB
          Xuan Gong
        11. YARN-71.7.patch
          14 kB
          Xuan Gong
        12. YARN-71.8.patch
          21 kB
          Xuan Gong
        13. YARN-71.9.patch
          21 kB
          Xuan Gong

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. YARN-3468 NM should not blindly rename usercache/filecache/nmPrivate on restart

          • Major - Major loss of function.
          • Resolved
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. YARN-70 nodemanager doesn't cleanup old logs/local files after restart

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. YARN-72 NM should handle cleaning up containers when it shuts down

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. YARN-661 NM fails to cleanup local directories for users

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-194 Log handling in case of NM restart.

          • Major - Major loss of function.
          • Reopened

          Bug - A problem which impairs or prevents the functions of the product. YARN-438 NM on startup should handle cleaning up of any running containers managed by the previous instance

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-73 nodemanager should cleanup running containers when it starts

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              xgong Xuan Gong
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: