Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-284

CRC for ChunksData

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • None
    • None

    Description

      This Jira is to add CRC for chunks data.
      Right now a Chunk Info structure looks like this:

      message ChunkInfo {
       required string chunkName = 1;
       required uint64 offset = 2;
       required uint64 len = 3;
       optional string checksum = 4;
       repeated KeyValue metadata = 5;
      }

       
      Proposal is to change ChunkInfo structure as below:
      message ChunkInfo {
       required string chunkName = 1 ;
       required uint64 offset = 2 ;
       required uint64 len = 3 ;
       repeated KeyValue metadata = 4;
       required ChecksumData checksumData = 5;
      }

       

      The ChecksumData structure would be as follows:
      message ChecksumData {
       required ChecksumType type = 1;
       required uint32 bytesPerChecksum = 2;
       repeated bytes checksums = 3;
      }
       
      Instead of changing disk format, we put the checksum into chunkInfo.

      Attachments

        1. Interleaving CRC and Error Detection for Containers.pdf
          158 kB
          Bharat Viswanadham
        2. HDDS-284.04.patch
          38 kB
          Bharat Viswanadham
        3. HDDS-284.03.patch
          39 kB
          Bharat Viswanadham
        4. HDDS-284.02.patch
          84 kB
          Bharat Viswanadham
        5. HDDS-284.01.patch
          85 kB
          Bharat Viswanadham
        6. HDDS-284.006.patch
          64 kB
          Hanisha Koneru
        7. HDDS-284.005.patch
          64 kB
          Hanisha Koneru
        8. HDDS-284.00.patch
          51 kB
          Shashikant Banerjee
        9. CRC and Error Detection for Containers.pdf
          140 kB
          Hanisha Koneru

        Activity

          People

            hanishakoneru Hanisha Koneru
            bharat Bharat Viswanadham
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: