Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2155

RaidNode should optionally dispatch map reduce jobs to fix corrupt blocks (instead of fixing locally)

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: contrib/raid
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Recomputing blocks based on parity information is expensive. Rather than doing this locally at the RaidNode, we should run map reduce jobs. This will allow us to quickly fix a large number of corrupt or missing blocks.

        Attachments

        1. MAPREDUCE-2155.patch
          120 kB
          Patrick Kling
        2. MAPREDUCE-2155.2.patch
          119 kB
          Patrick Kling

          Issue Links

            Activity

              People

              • Assignee:
                pkling Patrick Kling
                Reporter:
                pkling Patrick Kling
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: