Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      There is a known issue in HBase client that single slow/dead region server could slow down the multiput operations across all the region servers. So the HBase client will be as slow as the slowest region server in the cluster.

      To solve this problem, HTableMultiplexer will separate the multiput submitting threads with the flush threads, which means the multiput operation will be a nonblocking operation.
      The submitting thread will shard all the puts into different queues based on its destination region server and return immediately. The flush threads will flush these puts from each queue to its destination region server.

      Currently the HTableMultiplexer only supports the put operation.

        Attachments

        1. 5776-trunk-V3.patch
          27 kB
          Ted Yu
        2. 5776-trunk-V4.patch
          27 kB
          Ted Yu
        3. 5776-trunk-V5.patch
          27 kB
          Ted Yu
        4. 5776-trunk-V6.patch
          27 kB
          Ted Yu
        5. 5776-trunk-V7.patch
          26 kB
          Ted Yu
        6. ASF.LICENSE.NOT.GRANTED--D2775.1.patch
          21 kB
          Phabricator
        7. ASF.LICENSE.NOT.GRANTED--D2775.1.patch
          21 kB
          Phabricator
        8. ASF.LICENSE.NOT.GRANTED--D2775.2.patch
          27 kB
          Phabricator
        9. ASF.LICENSE.NOT.GRANTED--D2775.2.patch
          27 kB
          Phabricator
        10. ASF.LICENSE.NOT.GRANTED--D2775.3.patch
          30 kB
          Phabricator
        11. ASF.LICENSE.NOT.GRANTED--D2775.4.patch
          29 kB
          Phabricator
        12. ASF.LICENSE.NOT.GRANTED--D2775.5.patch
          28 kB
          Phabricator
        13. HBASE-5776-trunk.patch
          26 kB
          binlijin
        14. HBASE-5776-trunk-V2.patch
          27 kB
          binlijin

          Activity

            People

            • Assignee:
              aoxiang binlijin
              Reporter:
              liyin Liyin Tang
            • Votes:
              3 Vote for this issue
              Watchers:
              24 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: