Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-17854

Use StealJobQueue in HFileCleaner after HBASE-17215

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • None
    • None
    • Reviewed

    Description

      In HBASE-17215 we use specific threads for deleting large/small (archived) hfiles, and will improve it from below aspects in this JIRA:
      1. Using StealJobQueue to allow large file deletion thread to steal jobs from small queue, based on the experience that in real world there'll be much more small hfiles
      2. StealJobQueue is a kind of PriorityQueue, so we could also delete from the larger file in the queues.

      Attachments

        1. HBASE-17854.v5.patch
          16 kB
          Yu Li
        2. HBASE-17854.v5.patch
          16 kB
          Yu Li
        3. HBASE-17854.v4.patch
          16 kB
          Yu Li
        4. HBASE-17854.v3.patch
          12 kB
          Yu Li
        5. HBASE-17854.v2.patch
          12 kB
          Yu Li
        6. HBASE-17854.patch
          12 kB
          Yu Li

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-17215 Separate small/large file delete threads in HFileCleaner to accelerate archived hfile cleanup speed

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              liyu Yu Li
              liyu Yu Li
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: