Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5033

Opening/Closing store in parallel to reduce region open/close time

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.94.0
    • None
    • None
    • Hide
      "hbase.hstore.open.and.close.threads.max" is introduced to control the number of threads for opening/closing Store and store files.
      Show
      "hbase.hstore.open.and.close.threads.max" is introduced to control the number of threads for opening/closing Store and store files.

    Description

      Region servers are opening/closing each store and each store file for every store in sequential fashion, which may cause inefficiency to open/close regions.

      So this diff is to open/close each store in parallel in order to reduce region open/close time. Also it would help to reduce the cluster restart time.

      1) Opening each store in parallel
      2) Loading each store file for every store in parallel
      3) Closing each store in parallel
      4) Closing each store file for every store in parallel.

      Attachments

        1. HBASE-5033.patch
          18 kB
          Liyin Tang
        2. 5033-trunk.txt
          17 kB
          Ted Yu
        3. 5033.txt
          18 kB
          Ted Yu
        4. ASF.LICENSE.NOT.GRANTED--D933.5.patch
          18 kB
          Phabricator
        5. ASF.LICENSE.NOT.GRANTED--D933.4.patch
          18 kB
          Phabricator
        6. ASF.LICENSE.NOT.GRANTED--D933.3.patch
          17 kB
          Phabricator
        7. ASF.LICENSE.NOT.GRANTED--D933.2.patch
          17 kB
          Phabricator
        8. ASF.LICENSE.NOT.GRANTED--D933.1.patch
          17 kB
          Phabricator

        Activity

          People

            liyin Liyin Tang
            liyin Liyin Tang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: