Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1302

TrackerDistributedCacheManager can delete file asynchronously

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2, 0.21.0, 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: tasktracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      With the help of AsyncDiskService from MAPREDUCE-1213, we should be able to delete files from distributed cache asynchronously.

      That will help make task initialization faster, because task initialization calls the code that localizes files into the cache and may delete some other files.
      The deletion can slow down the task initialization speed.

      1. MAPREDUCE-1302.branch-0.20.on.top.of.MAPREDUCE-1213.3.patch
        42 kB
        Zheng Shao
      2. MAPREDUCE-1302.branch-0.20.on.top.of.MAPREDUCE-1213.2.patch
        42 kB
        Zheng Shao
      3. MAPREDUCE-1302.5.patch
        26 kB
        Zheng Shao
      4. MAPREDUCE-1302.4.patch
        26 kB
        Zheng Shao
      5. MAPREDUCE-1302.3.patch
        22 kB
        Zheng Shao
      6. MAPREDUCE-1302.2.patch
        21 kB
        Zheng Shao
      7. MAPREDUCE-1302.1.patch
        8 kB
        Zheng Shao
      8. MAPREDUCE-1302.0.patch
        19 kB
        Zheng Shao

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Zheng Shao
              Reporter:
              Zheng Shao
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development