Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8223

Should calculate checksum for parity blocks in DFSStripedOutputStream

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      DFSPacket p = createPacket(packetSize, chunksPerPacket,
      streamer.getBytesCurBlock(),
      streamer.getAndIncCurrentSeqno(), false);
      int maxBytesToPacket = p.getMaxChunks() * bytesPerChecksum;
      int toWrite = byteBuffer.remaining() > maxBytesToPacket ?
      maxBytesToPacket: byteBuffer.remaining();
      p.writeData(byteBuffer, toWrite);
      streamer.incBytesCurBlock(toWrite);
      packets.add(p);

      In DFSStripedOutputStream, have not calculated checksum for parity blocks in DFSStripedOutputStream.

      Attachments

        1. HDFS-8223.rebase.patch
          3 kB
          Jing Zhao
        2. HDFS-8223.001.patch
          3 kB
          Yi Liu

        Activity

          People

            hitliuyi Yi Liu
            hitliuyi Yi Liu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: