Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-3969

Outdated data can not be cleaned in time

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.90.1, 0.90.2, 0.90.3
    • 0.90.4
    • regionserver
    • None
    • Reviewed

    Description

      Compaction checker will send regions to the compact queue to do compact. But the priority of these regions is too low if these regions have only a few storefiles. When there is large through output, and the compact queue will aways have some regions with higher priority. This may causing the major compact be delayed for a long time(even a few days), and outdated data cleaning will also be delayed.
      In our test case, we found some regions sent to the queue by major compact checker hunging in the queue for more than 2 days! Some scanners on these regions cannot get availably data for a long time and lease expired.

      Attachments

        1. HBASE-3969-solution1.patch
          2 kB
          zhoushuaifeng
        2. HBASE-3969-solution1-for-branch.patch
          1 kB
          zhoushuaifeng
        3. HBASE-3969-solution1-for-branch-v2.patch
          2 kB
          zhoushuaifeng
        4. HBASE-3969-solution1-for-branch-v3.patch
          2 kB
          zhoushuaifeng
        5. HBASE-3969-solution1-for-branch-v4.patch
          2 kB
          zhoushuaifeng
        6. HBASE-3969-solution1-for-trunk-v2.patch
          2 kB
          zhoushuaifeng
        7. HBASE-3969-solution1-for-trunk-v3.patch
          3 kB
          zhoushuaifeng
        8. HBASE-3969-solution1-for-trunk-v4.patch
          2 kB
          zhoushuaifeng

        Activity

          People

            zhoushuaifeng zhoushuaifeng
            zhoushuaifeng zhoushuaifeng
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: