HBase
  1. HBase
  2. HBASE-5199

Delete out of TTL store files before compaction selection

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      set hbase.store.delete.expired.storefile as true to enable the expired store file deletion

      Description

      Currently, HBase deletes the out of TTL store files after compaction. We can change the sequence to delete the out of TTL store files before selecting store files for compactions.
      In this way, HBase can keep deleting the old invalid store files without compaction, and also prevent from unnecessary compactions since the out of TTL store files will be deleted before the compaction selection.

      1. ASF.LICENSE.NOT.GRANTED--D1311.1.patch
        5 kB
        Phabricator
      2. ASF.LICENSE.NOT.GRANTED--D1311.2.patch
        5 kB
        Phabricator
      3. ASF.LICENSE.NOT.GRANTED--D1311.3.patch
        5 kB
        Phabricator
      4. ASF.LICENSE.NOT.GRANTED--D1311.4.patch
        7 kB
        Phabricator
      5. ASF.LICENSE.NOT.GRANTED--D1311.5.patch
        8 kB
        Phabricator
      6. ASF.LICENSE.NOT.GRANTED--D1311.5.patch
        8 kB
        Phabricator
      7. hbase-5199.patch
        12 kB
        Liyin Tang

        Issue Links

          Activity

          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Nicolas Spiegelberg made changes -
          Link This issue breaks HBASE-5568 [ HBASE-5568 ]
          Ted Yu made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Ted Yu made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 0.94.0 [ 12316419 ]
          Ted Yu made changes -
          Comment [ mbautin has commented on the revision "[jira][HBASE-5199] Delete out of TTL store files before compaction selection ".

            @Liyin: could you please post the rebased version of the patch so I can commit?

          REVISION DETAIL
            https://reviews.facebook.net/D1311
          ]
          Liyin Tang made changes -
          Attachment hbase-5199.patch [ 12514057 ]
          Liyin Tang made changes -
          Attachment HBASE-5199.patch [ 12512236 ]
          Liyin Tang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note set hbase.store.delete.expired.storefile as true to enable the expired store file deletion
          Liyin Tang made changes -
          Attachment HBASE-5199.patch [ 12512236 ]
          Liyin Tang made changes -
          Link This issue relates to HBASE-4717 [ HBASE-4717 ]
          Liyin Tang made changes -
          Link This issue is blocked by HBASE-5274 [ HBASE-5274 ]
          Phabricator made changes -
          Attachment D1311.5.patch [ 12511737 ]
          Phabricator made changes -
          Attachment D1311.5.patch [ 12511708 ]
          Phabricator made changes -
          Attachment D1311.4.patch [ 12511701 ]
          Phabricator made changes -
          Attachment D1311.3.patch [ 12511045 ]
          Phabricator made changes -
          Attachment D1311.2.patch [ 12511044 ]
          Phabricator made changes -
          Attachment D1311.1.patch [ 12511024 ]
          Liyin Tang made changes -
          Field Original Value New Value
          Description Currently, HBase deletes the out of TTL store files after major compaction. We can change the sequence to delete the out of TTL store files before selecting store files for compactions.
          In this way, HBase can keep deleting the old invalid store files without major compaction, and also prevent from unnecessary major compactions since the out of TTL store files will be deleted before the compaction selection.
          Currently, HBase deletes the out of TTL store files after compaction. We can change the sequence to delete the out of TTL store files before selecting store files for compactions.
          In this way, HBase can keep deleting the old invalid store files without compaction, and also prevent from unnecessary compactions since the out of TTL store files will be deleted before the compaction selection.
          Liyin Tang created issue -

            People

            • Assignee:
              Liyin Tang
              Reporter:
              Liyin Tang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development