Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-17241

Avoid compacting already compacted mob files with _del files

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.0.0
    • Component/s: mob
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Today if there is only one file in the partition, and there is no _del files, the file is skipped. With del file, the current logic is to compact the already-compacted file with _del file. Let's say there is one mob file regionA20161101**, which was compacted. On 12/1/2016, there is _del file regionB20161201_del, mob compaction kicks in, regionA20161101** is less than the threshold, and it is picked for compaction. Since there is a _del file, regionA20161101**** and regionB20161201**_del are compacted into regionA20161101_1 . After that, regionB20161201_del cannot be deleted since it is not a allFile compaction. The next mob compaction, regionA20161101_1 and regionB20161201_del will be picked up again and be compacted into regionA20161101**_2. So in this case, it will cause more unnecessary IOs.

        Attachments

        1. HBASE-17241.master.001.patch
          2 kB
          Hua Xiang
        2. HBASE-17241-master-002.patch
          6 kB
          Hua Xiang
        3. HBASE-17241-master-003.patch
          6 kB
          Hua Xiang

          Activity

            People

            • Assignee:
              huaxiang Hua Xiang
              Reporter:
              huaxiang Hua Xiang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: