Description
Currently FileSystem provides both an interface and a mechanism for computing and checking crc files. I propose splitting the crc code into a nestable FileSystem that like the PhasedFileSystem has a backing FileSystem. Once the Paths are converted to URI, this is fairly natural to express. To use crc files, your uris will look like:
crc://hdfs:%2f%2fhost1:8020/ which is a crc FileSystem with an underlying file system of hdfs://host1:8020
This will allow users to use crc files where they make sense for their application/cluster and get rid of the "raw" methods.
Attachments
Issue Links
- relates to
-
HADOOP-928 make checksums optional per FileSystem
-
- Closed
-