Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1428

Make block size and the size of archive created files configurable.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: harchive
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently the block size used by archives is the default block size of the hdfs filesystem. We need to make it configurable so that the block size can be higher for the part files that archives create.
      Also, we need to make the size of part files in archives configurable again to make it bigger in size and create less number of such files.

        Attachments

        1. BinaryFileGenerator.java
          18 kB
          Tsz-wo Sze
        2. BinaryFileGenerator.java
          10 kB
          Tsz-wo Sze
        3. BinaryFileGenerator.java
          7 kB
          Tsz-wo Sze
        4. MAPREDUCE-1428.patch
          9 kB
          Mahadev Konar
        5. MAPREDUCE-1428.patch
          9 kB
          Mahadev Konar

        Issue Links

          Activity

            People

            • Assignee:
              mahadev Mahadev Konar
              Reporter:
              mahadev Mahadev Konar

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment