Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13460

Revise the MetaLookupPool executor-related defaults (introduced in HBASE-13036)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0, 2.0.0
    • None
    • None

    Description

      The value of the max threads, max tasks, etc. can be improved to not unnecessarily reject tasks. In one of our internal tests, we saw tasks getting rejected (with the defaults that is currently there in the unpatched code):

      2015-04-09 12:36:34,111|beaver.machine|INFO|15134|140028818736896|MainThread|Caused by: java.lang.RuntimeException: java.util.concurrent.RejectedExecutionException: Task 
      org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture@6658c97b rejected from 
      java.util.concurrent.ThreadPoolExecutor@5a06eeee[Running, pool size = 3, active threads = 3, queued tasks = 300, completed tasks = 0]
      2015-04-09 12:36:34,111|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:208)
      2015-04-09 12:36:34,112|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.ClientSmallReversedScanner.next(ClientSmallReversedScanner.java:145)
      2015-04-09 12:36:34,112|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1246)
      2015-04-09 12:36:34,112|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
      2015-04-09 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
      2015-04-09 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
      2015-04-09 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
      2015-04-09 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
      2015-04-09 12:36:34,114|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1414)
      2015-04-09 12:36:34,114|beaver.machine|INFO|15134|140028818736896|MainThread|at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1010)
      

      Attachments

        1. 13460-master-3.txt
          4 kB
          Devaraj Das
        2. 13460-master-2.txt
          4 kB
          Devaraj Das
        3. 13460-master-1.txt
          4 kB
          Devaraj Das

        Issue Links

          Activity

            People

              ddas Devaraj Das
              ddas Devaraj Das
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: