HBase
  1. HBase
  2. HBASE-5161

Compaction algorithm should prioritize reference files

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Incomplete
    • Affects Version/s: 0.92.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      I got myself into a state where my table was un-splittable as long as the insert load was coming in. Emergency flushes because of the low memory barrier don't check the number of store files so it never blocks, to a point where I had in one case 45 store files and the compactions were almost never done on the reference files (had 15 of them, went down by one in 20 minutes). Since you can't split regions with reference files, that region couldn't split and was doomed to just get more store files until the load stopped.

      Marking this as a minor issue, what we really need is a better pushback mechanism but not prioritizing reference files seems wrong.

        Activity

        Jean-Daniel Cryans created issue -
        stack made changes -
        Field Original Value New Value
        Priority Minor [ 4 ] Critical [ 2 ]
        Jean-Daniel Cryans made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Invalid [ 6 ]
        ramkrishna.s.vasudevan made changes -
        Resolution Invalid [ 6 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.94.1 [ 12320257 ]
        Fix Version/s 0.94.0 [ 12316419 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.94.1 [ 12320257 ]
        Andrew Purtell made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Fix Version/s 0.92.1 [ 12318551 ]
        Resolution Incomplete [ 4 ]

          People

          • Assignee:
            Unassigned
            Reporter:
            Jean-Daniel Cryans
          • Votes:
            1 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development