Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1302

TrackerDistributedCacheManager can delete file asynchronously

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2, 0.21.0, 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: tasktracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      With the help of AsyncDiskService from MAPREDUCE-1213, we should be able to delete files from distributed cache asynchronously.

      That will help make task initialization faster, because task initialization calls the code that localizes files into the cache and may delete some other files.
      The deletion can slow down the task initialization speed.

        Attachments

        1. MAPREDUCE-1302.0.patch
          19 kB
          Zheng Shao
        2. MAPREDUCE-1302.1.patch
          8 kB
          Zheng Shao
        3. MAPREDUCE-1302.2.patch
          21 kB
          Zheng Shao
        4. MAPREDUCE-1302.3.patch
          22 kB
          Zheng Shao
        5. MAPREDUCE-1302.4.patch
          26 kB
          Zheng Shao
        6. MAPREDUCE-1302.5.patch
          26 kB
          Zheng Shao
        7. MAPREDUCE-1302.branch-0.20.on.top.of.MAPREDUCE-1213.2.patch
          42 kB
          Zheng Shao
        8. MAPREDUCE-1302.branch-0.20.on.top.of.MAPREDUCE-1213.3.patch
          42 kB
          Zheng Shao

          Issue Links

            Activity

              People

              • Assignee:
                zshao Zheng Shao
                Reporter:
                zshao Zheng Shao
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: