Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2436

RAID block fixer should prioritize block fix operations

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.20.2, 0.20.3
    • Fix Version/s: None
    • Component/s: contrib/raid
    • Labels:
      None

      Description

      The RAID block fixer submits mapreduce jobs to fix corrupt files. This is OK for XOR RAID, but with Reed-Solomon RAID, there can be large number of corrupt files when even a single datanode goes dead. With Reed-SOlomon RAID, it is better to categorize corrupt files based on urgency. Files with only one corrupt block can be treated as lower priority than those with more number of corrupt blocks.

        Attachments

          Activity

            People

            • Assignee:
              rvadali Ramkumar Vadali
              Reporter:
              rvadali Ramkumar Vadali
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: