Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13420

RegionEnvironment.offerExecutionLatency Blocks Threads under Heavy Load

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The ArrayBlockingQueue blocks threads for 20s during a performance run focusing on creating numerous small scans.

      I see a buffer size of (100)

      private final BlockingQueue<Long> coprocessorTimeNanos = new ArrayBlockingQueue<Long>(
      LATENCY_BUFFER_SIZE);

      and then I see a drain coming from
      MetricsRegionWrapperImpl with 45 second executor
      HRegionMetricsWrapperRunable
      RegionCoprocessorHost#getCoprocessorExecutionStatistics()
      RegionCoprocessorHost#getExecutionLatenciesNanos()

      Am I missing something?

        Attachments

        1. 1M-0.98.12.svg
          689 kB
          Andrew Kyle Purtell
        2. 1M-0.98.13-SNAPSHOT.svg
          673 kB
          Andrew Kyle Purtell
        3. HBASE-13420.patch
          9 kB
          Andrew Kyle Purtell
        4. hbase-13420.tar.gz
          10 kB
          Andrew Kyle Purtell
        5. HBASE-13420.txt
          0.7 kB
          John Leach
        6. offerExecutionLatency.tiff
          207 kB
          John Leach

          Issue Links

            Activity

              People

              • Assignee:
                apurtell Andrew Kyle Purtell
                Reporter:
                jleach John Leach
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 3h
                  3h
                  Remaining:
                  Remaining Estimate - 3h
                  3h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified