HBase
  1. HBase
  2. HBASE-4805

Allow better control of resource consumption in HTable

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.92.0, 0.94.0
    • Fix Version/s: 0.92.0, 0.94.0
    • Component/s: Client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      From some internal discussions at Salesforce we concluded that we need better control over the resources (mostly threads) consumed by HTable when used in a AppServer with many client threads.

      Since HTable is not thread safe, the only options are cache them (in a custom thread local or using HTablePool) or to create them on-demand.

      I propose a simple change: Add a new constructor to HTable that takes an optional ExecutorService and HConnection instance. That would make HTable a pretty lightweight object and we would manage the ES and HC separately.

      I'll upload a patch a soon to get some feedback.

      1. 4805.txt
        5 kB
        Lars Hofhansl
      2. 4805-v2.txt
        5 kB
        Lars Hofhansl
      3. 4805-v3.txt
        12 kB
        Lars Hofhansl
      4. 4805-v4.txt
        12 kB
        Lars Hofhansl
      5. 4805-v5.txt
        12 kB
        Lars Hofhansl

        Issue Links

        There are no Sub-Tasks for this issue.

          Activity

          Gavin made changes -
          Link This issue is depended upon by HBASE-6580 [ HBASE-6580 ]
          Gavin made changes -
          Link This issue blocks HBASE-6580 [ HBASE-6580 ]
          Adrian Muraru made changes -
          Attachment HBASE-6580_v1.patch [ 12554093 ]
          Adrian Muraru made changes -
          Attachment HBASE-6580_v1.patch [ 12554093 ]
          Adrian Muraru made changes -
          Link This issue blocks HBASE-6580 [ HBASE-6580 ]
          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Lars Hofhansl made changes -
          Link This issue relates to HBASE-5084 [ HBASE-5084 ]
          Lars Hofhansl made changes -
          Link This issue relates to HBASE-4968 [ HBASE-4968 ]
          Lars Hofhansl made changes -
          Link This issue relates to HBASE-4956 [ HBASE-4956 ]
          Lars Hofhansl made changes -
          Link This issue relates to HBASE-4970 [ HBASE-4970 ]
          Lars Hofhansl made changes -
          Link This issue relates to HBASE-4787 [ HBASE-4787 ]
          Lars Hofhansl made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Lars Hofhansl made changes -
          Attachment 4805-v5.txt [ 12504136 ]
          Lars Hofhansl made changes -
          Attachment 4805-v4.txt [ 12504130 ]
          Lars Hofhansl made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Lars Hofhansl made changes -
          Attachment 4805-v3.txt [ 12504089 ]
          Lars Hofhansl made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Lars Hofhansl made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.92.0 [ 12314223 ]
          Lars Hofhansl made changes -
          Attachment 4805-v2.txt [ 12504032 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.0 [ 12316419 ]
          Affects Version/s 0.92.0 [ 12314223 ]
          Lars Hofhansl made changes -
          Field Original Value New Value
          Attachment 4805.txt [ 12504019 ]
          Lars Hofhansl created issue -

            People

            • Assignee:
              Lars Hofhansl
              Reporter:
              Lars Hofhansl
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development