Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15594 [YCSB] Improvements
  3. HBASE-15971

Regression: Random Read/WorkloadC slower in 1.x than 0.98

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 2.0.0
    • Fix Version/s: 1.3.0, 2.0.0
    • Component/s: rpc, Scheduler
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      Change the default rpc scheduler from 'deadline' to 'fifo' instead so it is the same as in branch 0.98. 'deadline' was of questionable benefit but with a high cost scheduling. To re-enable 'deadline', set hbase.ipc.server.callqueue.type to 'deadline' in your hbase-site.xml.
      Show
      Change the default rpc scheduler from 'deadline' to 'fifo' instead so it is the same as in branch 0.98. 'deadline' was of questionable benefit but with a high cost scheduling. To re-enable 'deadline', set hbase.ipc.server.callqueue.type to 'deadline' in your hbase-site.xml.

      Description

      branch-1 is slower than 0.98 doing YCSB random read/workloadC. It seems to be doing about 1/2 the throughput of 0.98.

      In branch-1, we have low handler occupancy compared to 0.98. Hacking in reader thread occupancy metric, is about the same in both. In parent issue, hacking out the scheduler, I am able to get branch-1 to go 3x faster so will dig in here.

        Attachments

        1. HBASE-15971.branch-1.002.patch
          6 kB
          Michael Stack
        2. flight_recording_10172402220203_28.branch-1.jfr
          9.02 MB
          Michael Stack
        3. flight_recording_10172402220203_29.09820.0.98.20.jfr
          12.42 MB
          Michael Stack
        4. Screen Shot 2016-06-10 at 5.08.24 PM.png
          1.02 MB
          Michael Stack
        5. Screen Shot 2016-06-10 at 5.08.26 PM.png
          527 kB
          Michael Stack
        6. run_ycsb.sh
          7 kB
          Michael Stack
        7. hits.patched1.0.vs.unpatched1.0.vs.098.png
          16 kB
          Michael Stack
        8. handlers.fp.png
          25 kB
          Michael Stack
        9. hits.fp.png
          16 kB
          Michael Stack
        10. HBASE-15971.branch-1.001.patch
          23 kB
          Michael Stack
        11. 098.png
          26 kB
          Michael Stack
        12. branch-1.png
          31 kB
          Michael Stack
        13. branch-1.hits.png
          15 kB
          Michael Stack
        14. 098.hits.png
          19 kB
          Michael Stack

          Issue Links

            Activity

              People

              • Assignee:
                stack Michael Stack
                Reporter:
                stack Michael Stack
              • Votes:
                0 Vote for this issue
                Watchers:
                21 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: