Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14790 Implement a new DFSOutputStream for logging WAL only
  3. HBASE-16890

Analyze the performance of AsyncWAL and fix the same

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0-beta-1, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      Tests reveal that AsyncWAL under load in single node cluster performs slower than the Default WAL. This task is to analyze and see if we could fix it.
      See some discussions in the tail of JIRA HBASE-15536.

      Attachments

        1. ycsb_FSHlog.vs.Async.png
          211 kB
          Chance Li
        2. Screen Shot 2016-11-04 at 5.30.18 PM.png
          220 kB
          Michael Stack
        3. Screen Shot 2016-11-04 at 5.21.27 PM.png
          325 kB
          Michael Stack
        4. AsyncWAL_disruptor_6.patch
          19 kB
          ramkrishna.s.vasudevan
        5. HBASE-16890-rc-v3.patch
          60 kB
          Duo Zhang
        6. HBASE-16890-rc-v2.patch
          53 kB
          Duo Zhang
        7. AsyncWAL_disruptor_4.patch
          19 kB
          ramkrishna.s.vasudevan
        8. AsyncWAL_disruptor_3.patch
          18 kB
          ramkrishna.s.vasudevan
        9. AsyncWAL_disruptor_3.patch
          18 kB
          ramkrishna.s.vasudevan
        10. HBASE-16890-remove-contention-v1.patch
          52 kB
          Duo Zhang
        11. AsyncWAL_disruptor_1 (2).patch
          16 kB
          ramkrishna.s.vasudevan
        12. HBASE-16890-remove-contention.patch
          42 kB
          Duo Zhang
        13. AsyncWAL_disruptor.patch
          16 kB
          ramkrishna.s.vasudevan
        14. Screen Shot 2016-10-25 at 7.39.48 PM.png
          454 kB
          Michael Stack
        15. Screen Shot 2016-10-25 at 7.39.07 PM.png
          552 kB
          Michael Stack
        16. Screen Shot 2016-10-25 at 7.34.47 PM.png
          581 kB
          Michael Stack
        17. classic.svg
          897 kB
          Michael Stack
        18. async.svg
          938 kB
          Michael Stack
        19. contention.png
          41 kB
          ramkrishna.s.vasudevan
        20. contention_defaultWAL.png
          39 kB
          ramkrishna.s.vasudevan

        Issue Links

          blocks

          Sub-task - The sub-task of the issue HBASE-15536 Make AsyncFSWAL as our default WAL

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-19371 Running WALPerformanceEvaluation against asyncfswal throws exceptions

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ram_krish ramkrishna.s.vasudevan
              ram_krish ramkrishna.s.vasudevan
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: