Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1428

Make block size and the size of archive created files configurable.

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: harchive
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently the block size used by archives is the default block size of the hdfs filesystem. We need to make it configurable so that the block size can be higher for the part files that archives create.
      Also, we need to make the size of part files in archives configurable again to make it bigger in size and create less number of such files.

        Attachments

        1. MAPREDUCE-1428.patch
          9 kB
          Mahadev konar
        2. MAPREDUCE-1428.patch
          9 kB
          Mahadev konar
        3. BinaryFileGenerator.java
          18 kB
          Tsz Wo Nicholas Sze
        4. BinaryFileGenerator.java
          10 kB
          Tsz Wo Nicholas Sze
        5. BinaryFileGenerator.java
          7 kB
          Tsz Wo Nicholas Sze

          Issue Links

            Activity

              People

              • Assignee:
                mahadev Mahadev konar
                Reporter:
                mahadev Mahadev konar
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: