Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6870

HTable#coprocessorExec always scan the whole table

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.94.1, 0.95.0, 0.95.2
    • 0.98.0, 0.94.8, 0.95.1
    • Coprocessors
    • None
    • Reviewed

    Description

      In current logic, HTable#coprocessorExec always scans the entire META table, loading it into memory and then filters the keys to return only those that fall in specified range. The version after the patch only scans the portions of meta that are in the specified key range, and returns them. Put simply – before we did a load-all-then-filter; afterwards we only-scan-what-is-needed.

      The former has low efficiency and greatly impacts the Regionserver carrying .META. when there are many coprocessorExec requests.

      Attachments

        1. 6870-v4.txt
          7 kB
          Ted Yu
        2. hbase-0.94-6870v6.patch
          4 kB
          Chunhui Shen
        3. hbase-0.95-6870v6.patch
          4 kB
          Chunhui Shen
        4. HBASE-6870.patch
          6 kB
          Chunhui Shen
        5. HBASE-6870-testPerformance.patch
          3 kB
          Chunhui Shen
        6. HBASE-6870v2.patch
          5 kB
          Chunhui Shen
        7. HBASE-6870v3.patch
          6 kB
          Chunhui Shen
        8. hbase-6870v5.patch
          7 kB
          Chunhui Shen
        9. hbase-6870v6.patch
          4 kB
          Chunhui Shen

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HBASE-8136 coprocessor service requires .meta. to be available all the time.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-5492 Caching StartKeys and EndKeys of Regions

          • Major - Major loss of function.
          • Closed
          is required by

          Umbrella - An overarching type made of sub-tasks HBASE-5843 Improve HBase MTTR - Mean Time To Recover

          • Major - Major loss of function.
          • Closed

          Activity

            People

              zjushch Chunhui Shen
              zjushch Chunhui Shen
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: