Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1823

Reduce the number of calls of HarFileSystem.getFileStatus in RaidNode

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.22.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      RaidNode makes lots of calls of HarFileSystem.getFileStatus. This method fetches information from DataNode so it is slow. It becomes the bottleneck of the RaidNode. It will be nice if we can make this more efficient.

        Activity

        Scott Chen created issue -
        Scott Chen made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-1823.txt [ 12447914 ]
        Scott Chen made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Scott Chen made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Nigel Daley made changes -
        Fix Version/s 0.22.0 [ 12314184 ]

          People

          • Assignee:
            Scott Chen
            Reporter:
            Scott Chen
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development