Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23349

Low refCount preventing archival of compacted away files

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Implemented
    • 3.0.0-alpha-1, 2.3.0, 1.6.0
    • None
    • None
    • None

    Description

      We have observed that refCount on compacted away store files as low as 1 is prevent archival.

      regionserver.HStore - Can't archive compacted file hdfs://{{root-dir}}/hbase/data/default/t1/12a9e1112e0371955b3db8d3ebb2d298/cf1/73b72f5ddfce4a34a9e01afe7b83c1f9 because of either isCompactedAway=true or file has reference, isReferencedInReads=true, refCount=1, skipping for now.

      We should come up with core code (run as part of discharger thread) gracefully resolve reader lock issue by resetting ongoing scanners to start pointing to new store files instead of compacted away store files.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HBASE-22460 Reopen a region if store reader references may have leaked

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-23212 Provide config reload for Auto Region Reopen based on storeFile ref count

          • Major - Major loss of function.
          • Resolved

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' HBASE-22457 Harden the HBase HFile reader reference counting

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #939

          Activity

            People

              Unassigned Unassigned
              vjasani Viraj Jasani
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: