Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2462

Review compaction heuristic and move compaction code out so standalone and independently testable

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Performance

      Description

      Anything that improves our i/o profile makes hbase run smoother. Over in HBASE-2457, good work has been done already describing the tension between minimizing compactions versus minimizing count of store files. This issue is about following on from what has been done in 2457 but also, breaking the hard-to-read compaction code out of Store.java out to a standalone class that can be the easier tested (and easily analyzed for its performance characteristics).

      If possible, in the refactor, we'd allow specification of alternate merge sort implementations.

        Attachments

        1. standalone.txt
          14 kB
          Michael Stack
        2. 2462v2.txt
          35 kB
          Michael Stack

          Issue Links

            Activity

              People

              • Assignee:
                streamy Jonathan Gray
                Reporter:
                stack Michael Stack
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: