Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8755 A new write thread model for HLog to improve the overall HBase write throughput
  3. HBASE-10156

FSHLog Refactor (WAS -> Fix up the HBASE-8755 slowdown when low contention)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.99.0
    • wal
    • None
    • Reviewed
    • A refactoring that inserts a ringbuffer (lmax disruptor) into the middle of the handler handoff of appends and sync More throughput for about the same latency when high contention.

    Description

      HBASE-8755 slows our writes when only a few clients. Fix.

      Attachments

        1. 10156.txt
          111 kB
          Michael Stack
        2. 10156v10.txt
          169 kB
          Michael Stack
        3. 10156v11.txt
          169 kB
          Michael Stack
        4. 10156v12.txt
          172 kB
          Michael Stack
        5. 10156v12.txt
          173 kB
          Michael Stack
        6. 10156v13.txt
          175 kB
          Michael Stack
        7. 10156v16.txt
          176 kB
          Michael Stack
        8. 10156v17.txt
          176 kB
          Michael Stack
        9. 10156v18.txt
          177 kB
          Michael Stack
        10. 10156v19.txt
          177 kB
          Michael Stack
        11. 10156v2.txt
          118 kB
          Michael Stack
        12. 10156v20.txt
          177 kB
          Michael Stack
        13. 10156v20.txt
          177 kB
          Michael Stack
        14. 10156v21.txt
          178 kB
          Michael Stack
        15. 10156v21.txt
          178 kB
          Michael Stack
        16. 10156v21.txt
          178 kB
          Michael Stack
        17. 10156v3.txt
          129 kB
          Michael Stack
        18. 10156v4.txt
          130 kB
          Michael Stack
        19. 10156v5.txt
          135 kB
          Michael Stack
        20. 10156v6.txt
          153 kB
          Michael Stack
        21. 10156v7.txt
          156 kB
          Michael Stack
        22. 10156v9.txt
          168 kB
          Michael Stack
        23. Disrupting.java
          10 kB
          Michael Stack

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HBASE-12339 WAL performance evaluation tool doesn't roll logs

          • Major - Major loss of function.
          • Closed
          incorporates

          Sub-task - The sub-task of the issue HBASE-10158 Add sync rate histogram to HLogPE

          • Major - Major loss of function.
          • Closed

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: