Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14790 Implement a new DFSOutputStream for logging WAL only
  3. HBASE-19344

improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0-beta-1, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      The logic now is that the netty #IO thread and asyncWal's thread are the same one.
      Improvement proposal:
      1, Split into two.
      2, All multiWal share the netty #IO thread pool.

      Attachments

        1. wal-1-test-result.png
          194 kB
          Chance Li
        2. wal-8-test-result.png
          210 kB
          Chance Li
        3. HBASE-19344-branch2.patch
          38 kB
          Chance Li
        4. ycsb_result_apache20_async_wal.pdf
          37 kB
          Chance Li
        5. HBASE-19344-branch2.patch.2.POC
          38 kB
          Chance Li
        6. HBASE-19344-branch.ycsb.png
          395 kB
          Chance Li
        7. HBASE-19344-branch.ycsb.png
          397 kB
          Chance Li
        8. HBASE-19344-branch-ycsb-1.png
          394 kB
          Chance Li
        9. HBASE-19344.patch
          32 kB
          Duo Zhang
        10. HBASE-19344-v1.patch
          37 kB
          Duo Zhang

        Activity

          People

            zhangduo Duo Zhang
            chancelq Chance Li
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: