Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-3727 MultiHFileOutputFormat
  3. HBASE-16261

MultiHFileOutputFormat Enhancement

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • mapreduce
    • None
    • Reviewed

    Description

      Change MultiHFileOutputFormat to MultiTableHFileOutputFormat, Continuing work to enhance the MultiTableHFileOutputFormat to make it more usable:

      MultiTableHFileOutputFormat follow HFileOutputFormat2
      (1) HFileOutputFormat2 can read one table's region split keys. and then output multiple hfiles for one family, and each hfile map to one region. We can add partitioner in MultiTableHFileOutputFormat to make it support this feature.

      (2) HFileOutputFormat2 support Customized Compression algorithm for column family and BloomFilter, also support customized DataBlockEncoding for the output hfiles. We can also make MultiTableHFileOutputFormat to support these features.

      Attachments

        1. HBASE-16261-V1.patch
          36 kB
          Yi Liang
        2. HBASE-16261-V2.patch
          39 kB
          Yi Liang
        3. HBASE-16261-V3.patch
          39 kB
          Yi Liang
        4. HBASE-16261-V4.patch
          43 kB
          Yi Liang
        5. HBASE-16261-V5.patch
          43 kB
          Yi Liang
        6. HBase-16261-V6.patch
          43 kB
          Yi Liang
        7. HBase-16261-V7.patch
          43 kB
          Yi Liang
        8. HBase-16261-V8.patch
          44 kB
          Yi Liang
        9. HBase-16261-V9.patch
          52 kB
          Yi Liang

        Issue Links

          Activity

            People

              easyliangjob Yi Liang
              easyliangjob Yi Liang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: