Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: hbase-11339
    • Fix Version/s: hbase-11339, 2.0.0
    • Component/s: Compaction, master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      From the design doc, mob files are not involved in the normal HBase compaction process. This means deleted mobs would still take up space and that we never really merge mob files that accrue over time. Currently, MOBs depend on two external tools:

      1) A TTL cleaner that removes mobs that have passed their TTL or exceeded minVersions.
      2) A 'sweep tool' cleaner that remove mobs that have had their references deleted and merges small files into larger ones.

      Today the tools are triggered by admins. The longer term goal would be to integrate them into hbase such that by default mobs are cleaned. The tools will be preserved however so that advanced admins can disable automatic cleanups and manually trigger these compaction like operaitons. #1 would likely be a chore in the master while #2 requires some design work to integrate into hbase.

        Attachments

        1. HBASE-11644.diff
          137 kB
          Jingcheng Du
        2. HBASE-11644-Sep-15.diff
          157 kB
          Jingcheng Du
        3. HBASE-11644-Sep-16.diff
          157 kB
          Jingcheng Du
        4. HBASE-11644-Sep-16.diff
          157 kB
          Jingcheng Du
        5. HBASE-11644-Sep-18.diff
          158 kB
          Jingcheng Du
        6. HBASE-11646-0918-bad.patch
          160 kB
          Jonathan Hsieh
        7. HBASE-11644-Sep-19.diff
          162 kB
          Jingcheng Du
        8. HBASE-11644-Sep-19-V2.patch
          162 kB
          Jingcheng Du

          Activity

            People

            • Assignee:
              jingcheng.du@intel.com Jingcheng Du
              Reporter:
              jingcheng.du@intel.com Jingcheng Du
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: