Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8949

hbase.mapreduce.hfileoutputformat.blocksize should configure with blocksize of a table

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.11
    • Component/s: mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      While writing hfiles from HFileOutputFormat forcing blocksize from table schema(HColumnDescriptor). Even if we configure hbase.mapreduce.hfileoutputformat.blocksize during bulkload/import it will be overridden with actual block size from table schema.
      Show
      While writing hfiles from HFileOutputFormat forcing blocksize from table schema(HColumnDescriptor). Even if we configure hbase.mapreduce.hfileoutputformat.blocksize during bulkload/import it will be overridden with actual block size from table schema.

      Description

      While initializing mapreduce job we are not configuring hbase.mapreduce.hfileoutputformat.blocksize, so hfiles are always creating with 64kb (default)block size even though tables has different block size.
      We need to configure it with block size from table descriptor.

        Attachments

        1. HBASE-8949_94_2.patch
          6 kB
          rajeshbabu
        2. HBASE-8949_94.patch
          4 kB
          rajeshbabu
        3. HBASE-8949_trunk_2.patch
          6 kB
          rajeshbabu
        4. HBASE-8949_trunk.patch
          4 kB
          rajeshbabu

          Activity

            People

            • Assignee:
              rajesh23 rajeshbabu
              Reporter:
              rajesh23 rajeshbabu
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: