Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14970

Backport HBASE-13082 and its sub-jira to branch-1

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.3.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      After this JIRA we will not be doing any scanner reset after compaction during a course of a scan. The files that were compacted will still be continued to be used in the scan process. The compacted files will be archived by a background thread that runs every 2 mins by default only when there are no active scanners on those comapcted files.

      'hbase.hfile.compaction.discharger.interval' describes the interval after which the compaction discharger chore service should run.
      The property 'hbase.hfile.compaction.discharger.thread.count' describes the thread count that does the compaction discharge work.

      The CompactedHFilesDischarger is a chore service now started as part of the RegionServer and this chore service iterates over all the onlineRegions in that RS and uses the RegionServer's executor service to launch a set of threads that does this job of compaction files clean up.
      Show
      After this JIRA we will not be doing any scanner reset after compaction during a course of a scan. The files that were compacted will still be continued to be used in the scan process. The compacted files will be archived by a background thread that runs every 2 mins by default only when there are no active scanners on those comapcted files. 'hbase.hfile.compaction.discharger.interval' describes the interval after which the compaction discharger chore service should run. The property 'hbase.hfile.compaction.discharger.thread.count' describes the thread count that does the compaction discharge work. The CompactedHFilesDischarger is a chore service now started as part of the RegionServer and this chore service iterates over all the onlineRegions in that RS and uses the RegionServer's executor service to launch a set of threads that does this job of compaction files clean up.

      Attachments

      1. HBASE-13082-branch-1.patch
        102 kB
        ramkrishna.s.vasudevan
      2. HBASE-14970_6.branch-1.patch
        116 kB
        ramkrishna.s.vasudevan
      3. HBASE-14970_7.branch-1.patch
        115 kB
        ramkrishna.s.vasudevan
      4. HBASE-14970_8.branch-1.patch
        116 kB
        ramkrishna.s.vasudevan
      5. HBASE-14970_9.branch-1.patch
        119 kB
        ramkrishna.s.vasudevan
      6. HBASE-14970_branch-1_1.patch
        103 kB
        ramkrishna.s.vasudevan
      7. HBASE-14970_branch-1_2.patch
        104 kB
        ramkrishna.s.vasudevan
      8. HBASE-14970_branch-1_4.patch
        116 kB
        ramkrishna.s.vasudevan
      9. HBASE-14970_branch-1_5.patch
        116 kB
        ramkrishna.s.vasudevan
      10. HBASE-14970_branch-1_6.patch
        116 kB
        ramkrishna.s.vasudevan
      11. HBASE-14970_branch-1.patch
        103 kB
        ramkrishna.s.vasudevan
      12. HBASE-14970_branch-1.patch
        103 kB
        ramkrishna.s.vasudevan
      13. HBASE-14970_branch-1.patch
        102 kB
        ramkrishna.s.vasudevan

        Issue Links

          Activity

            People

            • Assignee:
              ram_krish ramkrishna.s.vasudevan
              Reporter:
              ram_krish ramkrishna.s.vasudevan
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: