HBase
  1. HBase
  2. HBASE-7247

Assignment performances decreased by 50% because of regionserver.OpenRegionHandler#tickleOpening

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The regionserver.OpenRegionHandler#tickleOpening updates the region znode as "Do this so master doesn't timeout this region-in-transition.".
      However, on the usual test, this makes the assignment time of 1500 regions goes from 70s to 100s, that is, we're 50% slower because of this.
      More generally, ZooKeper commits to disk all the data update, and this takes time. Using it to provide a keep alive seems overkill. At the very list, it could be made asynchronous.

      I'm not sure how necessary these updates are required (I need to go deeper in the internal, feedback welcome), but it seems very important to optimize this... The trival fix would be to make this optional.

      1. 7247.v2.patch
        8 kB
        Nicolas Liochon
      2. 7247.v1.patch
        10 kB
        Nicolas Liochon

        Issue Links

          Activity

          Nicolas Liochon created issue -
          Nicolas Liochon made changes -
          Field Original Value New Value
          Link This issue is required by HBASE-5843 [ HBASE-5843 ]
          Nicolas Liochon made changes -
          Attachment 7247.v1.patch [ 12556092 ]
          Nicolas Liochon made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          stack made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          stack made changes -
          Priority Critical [ 2 ] Major [ 3 ]
          Nicolas Liochon made changes -
          Link This issue requires HBASE-7407 [ HBASE-7407 ]
          Nicolas Liochon made changes -
          Link This issue requires HBASE-7327 [ HBASE-7327 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          stack made changes -
          Fix Version/s 0.95.1 [ 12324288 ]
          Fix Version/s 0.95.0 [ 12324094 ]
          Nicolas Liochon made changes -
          Attachment 7247.v2.patch [ 12577192 ]
          Nicolas Liochon made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Nicolas Liochon made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 0.98.0 [ 12323143 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Nicolas Liochon
              Reporter:
              Nicolas Liochon
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development