Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-10239 Storage Container Reconciliation
  3. HDDS-10379

Datanodes should generate initial container merkle tree during container close

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None

    Description

      Open container replicas will not have a container merkle tree so that we do not need to keep updating this with every write request. Instead, the tree will be created on container close from the chunk checksums that are stored in RocksDB. Since these checksums should have been verified somewhat recently (with write checksum verification enabled), container close will build the merkle tree from these values without reading actual data blocks. Since should just be a hash of values stored contiguously in RocksDB, it should be a fast operation. The container scanner will come back asynchronously to update update the checksums based on the data it sees on disk at that time.

      Attachments

        Issue Links

          Activity

            People

              aswinshakil Aswin Shakil
              ritesh Ritesh Shukla
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: