Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8949

hbase.mapreduce.hfileoutputformat.blocksize should configure with blocksize of a table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.94.11
    • mapreduce
    • None
    • Reviewed
    • Hide
      While writing hfiles from HFileOutputFormat forcing blocksize from table schema(HColumnDescriptor). Even if we configure hbase.mapreduce.hfileoutputformat.blocksize during bulkload/import it will be overridden with actual block size from table schema.
      Show
      While writing hfiles from HFileOutputFormat forcing blocksize from table schema(HColumnDescriptor). Even if we configure hbase.mapreduce.hfileoutputformat.blocksize during bulkload/import it will be overridden with actual block size from table schema.

    Description

      While initializing mapreduce job we are not configuring hbase.mapreduce.hfileoutputformat.blocksize, so hfiles are always creating with 64kb (default)block size even though tables has different block size.
      We need to configure it with block size from table descriptor.

      Attachments

        1. HBASE-8949_94_2.patch
          6 kB
          rajeshbabu
        2. HBASE-8949_94.patch
          4 kB
          rajeshbabu
        3. HBASE-8949_trunk_2.patch
          6 kB
          rajeshbabu
        4. HBASE-8949_trunk.patch
          4 kB
          rajeshbabu

        Activity

          People

            rajesh23 rajeshbabu
            rajesh23 rajeshbabu
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: