Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12712

skipLargeFiles in minor compact but not in major compact

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.98.6
    • Fix Version/s: 0.98.6
    • Component/s: Compaction
    • Labels:

      Description

      Here is my case. After repeatedly minor compaction, the size of storefile is very large. Compaction with large storefile will waste much bandwidth, so i use the “hbase.hstore.compaction.max.size” to skip this case. But after use this config, i find that major compaction will be skipped forever when i read the source code and the deletes and muti-versions data my waste storage. So i had to modify the code.
      Now i'm try to submit my patch.But my patch is not perfect. I think there should be an other config to determine if the large size storefile should join major compaction in HColumnDescriptor.

        Attachments

        1. compact.diff
          1 kB
          Liu Junhong

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mopishv0 Liu Junhong
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 72h
                72h
                Remaining:
                Remaining Estimate - 72h
                72h
                Logged:
                Time Spent - Not Specified
                Not Specified