Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.0.0-alpha1
-
None
-
None
Description
When users read data from HDFS and require checksum verification, the checksum is validated by DFSClient before sending data to the user application.
Currently BlockSender has the option (corruptChecksumOk/verifyChecksum) to verify checksum. This option is not turned on anywhere in current code. Validating checksum on the server(DataNode) side is redundant since DFSClient still needs to do the same work again due to possible errors introduced by the data transportation from the server to the client.