Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12740

Improve performance of TestHBaseFsck

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.0.0, 1.1.0
    • util
    • None
    • Reviewed

    Description

      TestHBaseFsck performs poor on my machine. It crashes because the threads reach the 2000 thread limit on my machine. Looking at the code a lot of optimization is possible and some API calls are used wrong. A lot of Admin instances are created and never closed, lots of Tables are not closed, ThreadPoolExecutors are not shut down and an unlimited thread pool which does not recycle threads.

      Attachments

        1. HBASE-12740-v4.patch
          67 kB
          Jurriaan Mous
        2. HBASE-12740-v4.patch
          67 kB
          Jurriaan Mous
        3. PROFILE_before_patch_test_fails.png
          291 kB
          Jurriaan Mous
        4. PROFILE_after_patch.png
          269 kB
          Jurriaan Mous
        5. HBASE-12740-v3.patch
          66 kB
          Jurriaan Mous
        6. HBASE-12740-v2.patch
          66 kB
          Jurriaan Mous
        7. HBASE-12740-v1.patch
          65 kB
          Jurriaan Mous
        8. HBASE-12740.patch
          45 kB
          Jurriaan Mous

        Activity

          People

            jurmous Jurriaan Mous
            jurmous Jurriaan Mous
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: