Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-7247

Assignment performances decreased by 50% because of regionserver.OpenRegionHandler#tickleOpening

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The regionserver.OpenRegionHandler#tickleOpening updates the region znode as "Do this so master doesn't timeout this region-in-transition.".
      However, on the usual test, this makes the assignment time of 1500 regions goes from 70s to 100s, that is, we're 50% slower because of this.
      More generally, ZooKeper commits to disk all the data update, and this takes time. Using it to provide a keep alive seems overkill. At the very list, it could be made asynchronous.

      I'm not sure how necessary these updates are required (I need to go deeper in the internal, feedback welcome), but it seems very important to optimize this... The trival fix would be to make this optional.

        Attachments

        1. 7247.v2.patch
          8 kB
          Nicolas Liochon
        2. 7247.v1.patch
          10 kB
          Nicolas Liochon

          Issue Links

            Activity

              People

              • Assignee:
                nkeywal Nicolas Liochon
                Reporter:
                nkeywal Nicolas Liochon
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: