Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14970

Backport HBASE-13082 and its sub-jira to branch-1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3.0
    • 1.3.0
    • None
    • None
    • Reviewed
    • Hide
      After this JIRA we will not be doing any scanner reset after compaction during a course of a scan. The files that were compacted will still be continued to be used in the scan process. The compacted files will be archived by a background thread that runs every 2 mins by default only when there are no active scanners on those comapcted files.

      'hbase.hfile.compaction.discharger.interval' describes the interval after which the compaction discharger chore service should run.
      The property 'hbase.hfile.compaction.discharger.thread.count' describes the thread count that does the compaction discharge work.

      The CompactedHFilesDischarger is a chore service now started as part of the RegionServer and this chore service iterates over all the onlineRegions in that RS and uses the RegionServer's executor service to launch a set of threads that does this job of compaction files clean up.
      Show
      After this JIRA we will not be doing any scanner reset after compaction during a course of a scan. The files that were compacted will still be continued to be used in the scan process. The compacted files will be archived by a background thread that runs every 2 mins by default only when there are no active scanners on those comapcted files. 'hbase.hfile.compaction.discharger.interval' describes the interval after which the compaction discharger chore service should run. The property 'hbase.hfile.compaction.discharger.thread.count' describes the thread count that does the compaction discharge work. The CompactedHFilesDischarger is a chore service now started as part of the RegionServer and this chore service iterates over all the onlineRegions in that RS and uses the RegionServer's executor service to launch a set of threads that does this job of compaction files clean up.

    Attachments

      1. HBASE-13082-branch-1.patch
        102 kB
        ramkrishna.s.vasudevan
      2. HBASE-14970_6.branch-1.patch
        116 kB
        ramkrishna.s.vasudevan
      3. HBASE-14970_7.branch-1.patch
        115 kB
        ramkrishna.s.vasudevan
      4. HBASE-14970_8.branch-1.patch
        116 kB
        ramkrishna.s.vasudevan
      5. HBASE-14970_9.branch-1.patch
        119 kB
        ramkrishna.s.vasudevan
      6. HBASE-14970_branch-1_1.patch
        103 kB
        ramkrishna.s.vasudevan
      7. HBASE-14970_branch-1_2.patch
        104 kB
        ramkrishna.s.vasudevan
      8. HBASE-14970_branch-1_4.patch
        116 kB
        ramkrishna.s.vasudevan
      9. HBASE-14970_branch-1_5.patch
        116 kB
        ramkrishna.s.vasudevan
      10. HBASE-14970_branch-1_6.patch
        116 kB
        ramkrishna.s.vasudevan
      11. HBASE-14970_branch-1.patch
        103 kB
        ramkrishna.s.vasudevan
      12. HBASE-14970_branch-1.patch
        103 kB
        ramkrishna.s.vasudevan
      13. HBASE-14970_branch-1.patch
        102 kB
        ramkrishna.s.vasudevan

      Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. HBASE-13082 Coarsen StoreScanner locks to RegionScanner

        • Major - Major loss of function.
        • Closed
        relates to

        Sub-task - The sub-task of the issue HBASE-16788 Race in compacted file deletion between HStore close() and closeAndArchiveCompactedFiles()

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Sub-task - The sub-task of the issue HBASE-17887 Row-level consistency is broken for read

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Sub-task - The sub-task of the issue HBASE-17406 Occasional failed splits on branch-1.3

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. HBASE-15697 Excessive TestHRegion running time on branch-1

        • Major - Major loss of function.
        • Resolved

        Activity

          People

            ram_krish ramkrishna.s.vasudevan
            ram_krish ramkrishna.s.vasudevan
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: