Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-284

CRC for ChunksData

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • None
    • None

    Description

      This Jira is to add CRC for chunks data.
      Right now a Chunk Info structure looks like this:

      message ChunkInfo {
       required string chunkName = 1;
       required uint64 offset = 2;
       required uint64 len = 3;
       optional string checksum = 4;
       repeated KeyValue metadata = 5;
      }

       
      Proposal is to change ChunkInfo structure as below:
      message ChunkInfo {
       required string chunkName = 1 ;
       required uint64 offset = 2 ;
       required uint64 len = 3 ;
       repeated KeyValue metadata = 4;
       required ChecksumData checksumData = 5;
      }

       

      The ChecksumData structure would be as follows:
      message ChecksumData {
       required ChecksumType type = 1;
       required uint32 bytesPerChecksum = 2;
       repeated bytes checksums = 3;
      }
       
      Instead of changing disk format, we put the checksum into chunkInfo.

      Attachments

        1. CRC and Error Detection for Containers.pdf
          140 kB
          Hanisha Koneru
        2. HDDS-284.00.patch
          51 kB
          Shashikant Banerjee
        3. HDDS-284.005.patch
          64 kB
          Hanisha Koneru
        4. HDDS-284.006.patch
          64 kB
          Hanisha Koneru
        5. HDDS-284.01.patch
          85 kB
          Bharat Viswanadham
        6. HDDS-284.02.patch
          84 kB
          Bharat Viswanadham
        7. HDDS-284.03.patch
          39 kB
          Bharat Viswanadham
        8. HDDS-284.04.patch
          38 kB
          Bharat Viswanadham
        9. Interleaving CRC and Error Detection for Containers.pdf
          158 kB
          Bharat Viswanadham

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            hanishakoneru Hanisha Koneru Assign to me
            bharat Bharat Viswanadham
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment