Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11339 HBase MOB
  3. HBASE-11646

Handle the MOB in compaction

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • hbase-11339
    • hbase-11339, 2.0.0
    • Compaction
    • None
    • Reviewed

    Description

      In the updated MOB design however, admins can set CF level thresholds that would force cell values > the threshold to use the MOB write path instead of the traditional path. There are two cases where mobs need to interact with this threshold

      1) How do we handle the case when the threshold size is changed?
      2) Today, you can bulkload hfiles that contain MOBs. These cells will work as normal inside hbase. Unfortunately the cells with MOBs in them will never benefit form the MOB write path.

      The proposal here is to modify compaction in mob enabled cf's such that the threshold value is honored with compactions. This handles case #1 – elements that should be moved out of the normal hfiles get 'compacted' into refs and mob hfiles, and values that should be pulled into the cf get derefed and written out wholy in the compaction. For case #2, we can maintain the same behavior and compaction would move data into the mob writepath/lifecycle.

      Attachments

        1. HBASE-11646.diff
          26 kB
          Jingcheng Du
        2. hbase-11646-v10.patch
          36 kB
          Jonathan Hsieh
        3. HBASE-11646-V2.diff
          33 kB
          Jingcheng Du
        4. HBASE-11646-V3.diff
          33 kB
          Jingcheng Du
        5. HBASE-11646-V4.diff
          32 kB
          Jingcheng Du
        6. HBASE-11646-V5.diff
          32 kB
          Jingcheng Du
        7. HBASE-11646-V6.diff
          37 kB
          Jingcheng Du
        8. HBASE-11646-V7.diff
          35 kB
          Jingcheng Du
        9. hbase-11646-v8.patch
          36 kB
          Jonathan Hsieh
        10. HBASE-11646-V9.diff
          36 kB
          Jingcheng Du

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jingcheng.du@intel.com Jingcheng Du
            jingcheng.du@intel.com Jingcheng Du
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment