Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3159

DefaultContainerExecutor removes appcache dir on every localization

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • mrv2
    • None
    • Reviewed

    Description

      The DefaultContainerExecutor currently has code that removes the application dir from appcache/ in the local directories on every task localization. This causes any concurrent executing tasks from the same job to fail.

      Attachments

        1. mr-3159.txt
          32 kB
          Todd Lipcon
        2. mr-3159.txt
          33 kB
          Todd Lipcon
        3. mr-3159.txt
          12 kB
          Todd Lipcon
        4. fix-jdoc.txt
          2 kB
          Todd Lipcon

        Issue Links

          blocks

          Task - A task that needs to be done. MAPREDUCE-2986 Multiple node managers support for the MiniYARNCluster

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: