Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3177

Allow DFSClient to find out and use the CRC type being used for a file.

    Details

    • Hadoop Flags:
      Reviewed

      Description

      To support HADOOP-8060, DFSClient should be able to find out the checksum type being used for files in hdfs.
      In my prototype, DataTransferProtocol was extended to include the checksum type in the blockChecksum() response. DFSClient uses it in getFileChecksum() to determin the checksum type. Also append() can be configured to use the existing checksum type instead of the configured one.

      1. hdfs-3177-minimum-without-append-concat-trunk-branch2.patch.txt
        6 kB
        Kihwal Lee
      2. hdfs-3177-minimum-without-append-concat-branch-0.23.patch.txt
        7 kB
        Kihwal Lee
      3. hdfs-3177-branch2-trunk.patch.txt
        31 kB
        Kihwal Lee
      4. hdfs-3177-branch2-trunk.patch.txt
        29 kB
        Kihwal Lee
      5. hdfs-3177-branch2-trunk.patch.txt
        28 kB
        Kihwal Lee
      6. hdfs-3177-branch2-trunk.patch.txt
        26 kB
        Kihwal Lee
      7. hdfs-3177-branch2-trunk.patch.txt
        23 kB
        Kihwal Lee
      8. hdfs-3177-branch2-trunk.patch.txt
        23 kB
        Kihwal Lee
      9. hdfs-3177-branch2-trunk.patch.txt
        27 kB
        Kihwal Lee
      10. hdfs-3177-with-hadoop-8239.patch.txt
        38 kB
        Kihwal Lee
      11. hdfs-3177-after-hadoop-8239.patch.txt
        29 kB
        Kihwal Lee
      12. hdfs-3177-with-hadoop-8239-8240.patch.txt
        89 kB
        Kihwal Lee
      13. hdfs-3177-with-hadoop-8239-8240.patch.txt
        90 kB
        Kihwal Lee
      14. hdfs-3177-with-hadoop-8239-8240.patch.txt
        85 kB
        Kihwal Lee
      15. hdfs-3177-after-hadoop-8239-8240.patch.txt
        27 kB
        Kihwal Lee
      16. hdfs-3177.patch
        16 kB
        Kihwal Lee

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Kihwal Lee
              Reporter:
              Kihwal Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development