Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12740

Improve performance of TestHBaseFsck

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.0.0, 1.1.0
    • Component/s: util
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TestHBaseFsck performs poor on my machine. It crashes because the threads reach the 2000 thread limit on my machine. Looking at the code a lot of optimization is possible and some API calls are used wrong. A lot of Admin instances are created and never closed, lots of Tables are not closed, ThreadPoolExecutors are not shut down and an unlimited thread pool which does not recycle threads.

        Attachments

        1. HBASE-12740.patch
          45 kB
          Jurriaan Mous
        2. HBASE-12740-v1.patch
          65 kB
          Jurriaan Mous
        3. HBASE-12740-v2.patch
          66 kB
          Jurriaan Mous
        4. HBASE-12740-v3.patch
          66 kB
          Jurriaan Mous
        5. PROFILE_after_patch.png
          269 kB
          Jurriaan Mous
        6. PROFILE_before_patch_test_fails.png
          291 kB
          Jurriaan Mous
        7. HBASE-12740-v4.patch
          67 kB
          Jurriaan Mous
        8. HBASE-12740-v4.patch
          67 kB
          Jurriaan Mous

          Activity

            People

            • Assignee:
              jurmous Jurriaan Mous
              Reporter:
              jurmous Jurriaan Mous
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: