Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: contrib/raid
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Raid introduce the new dependency between blocks within a file.
      The blocks help decode each other. Therefore we should avoid put them on the same machine.

      The proposed BlockPlacementPolicy does the following
      1. When writing parity blocks, it avoid the parity blocks and source blocks sit together.
      2. When reducing replication number, it deletes the blocks that sits with other dependent blocks.
      3. It does not change the way we write normal files. It only has different behavior when processing raid files.

      1. MAPREDUCE-1831.txt
        7 kB
        Scott Chen
      2. MAPREDUCE-1831.v1.1.txt
        8 kB
        Scott Chen
      3. MAPREDUCE-1831.20100610.txt
        10 kB
        Scott Chen
      4. MAPREDUCE-1831-v2.txt
        45 kB
        Scott Chen
      5. test.result
        52 kB
        Scott Chen

        Issue Links

          Activity

            People

            • Assignee:
              Scott Chen
              Reporter:
              Scott Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development