Uploaded image for project: 'Hadoop Distributed Data Store'
  1. Hadoop Distributed Data Store
  2. HDDS-3283

Improve write efficiency by decreasing the number of force sync to disk

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The whole write cost about 140ms, and 110ms was cost by force sync to disk. The force sync operations are as follows.
      RocksDB

      1. When create key, the response was put into omDoubleBufferHelper, and sync to disk by writeOptions.setSync(true)
      2. When commit key, the response was put into omDoubleBufferHelper, and sync to disk by writeOptions.setSync(true)

      Ratis

      1. leader and follower sync raftlog to disk

        Attachments

          Activity

            People

            • Assignee:
              yjxxtd runzhiwang
              Reporter:
              yjxxtd runzhiwang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: