Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3177

Allow DFSClient to find out and use the CRC type being used for a file.

    Details

    • Hadoop Flags:
      Reviewed

      Description

      To support HADOOP-8060, DFSClient should be able to find out the checksum type being used for files in hdfs.
      In my prototype, DataTransferProtocol was extended to include the checksum type in the blockChecksum() response. DFSClient uses it in getFileChecksum() to determin the checksum type. Also append() can be configured to use the existing checksum type instead of the configured one.

        Attachments

        1. hdfs-3177-minimum-without-append-concat-trunk-branch2.patch.txt
          6 kB
          Kihwal Lee
        2. hdfs-3177-minimum-without-append-concat-branch-0.23.patch.txt
          7 kB
          Kihwal Lee
        3. hdfs-3177-branch2-trunk.patch.txt
          31 kB
          Kihwal Lee
        4. hdfs-3177-branch2-trunk.patch.txt
          29 kB
          Kihwal Lee
        5. hdfs-3177-branch2-trunk.patch.txt
          28 kB
          Kihwal Lee
        6. hdfs-3177-branch2-trunk.patch.txt
          26 kB
          Kihwal Lee
        7. hdfs-3177-branch2-trunk.patch.txt
          23 kB
          Kihwal Lee
        8. hdfs-3177-branch2-trunk.patch.txt
          23 kB
          Kihwal Lee
        9. hdfs-3177-branch2-trunk.patch.txt
          27 kB
          Kihwal Lee
        10. hdfs-3177-with-hadoop-8239.patch.txt
          38 kB
          Kihwal Lee
        11. hdfs-3177-after-hadoop-8239.patch.txt
          29 kB
          Kihwal Lee
        12. hdfs-3177-with-hadoop-8239-8240.patch.txt
          89 kB
          Kihwal Lee
        13. hdfs-3177-with-hadoop-8239-8240.patch.txt
          90 kB
          Kihwal Lee
        14. hdfs-3177-with-hadoop-8239-8240.patch.txt
          85 kB
          Kihwal Lee
        15. hdfs-3177-after-hadoop-8239-8240.patch.txt
          27 kB
          Kihwal Lee
        16. hdfs-3177.patch
          16 kB
          Kihwal Lee

          Issue Links

            Activity

              People

              • Assignee:
                kihwal Kihwal Lee
                Reporter:
                kihwal Kihwal Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: