[MAPREDUCE-7184] TestJobCounters byte counters omitting crc file bytes read

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 3.3.0
• Assignee: Steve Loughran
• Reporter: Prabhu Joseph
• Created: 10/Feb/19 17:32
• Updated: 23/Oct/19 16:14
• Resolved: 27/Feb/19 21:00

Description

TestJobCounters test cases are failing in trunk while validating the input files size with BYTES_READ by the job. The crc files are considered in getFileSize whereas the job FileInputFormat ignores them. has stopped reading the CRC counters

Issue Links

• is caused by: HADOOP-16107 FilterFileSystem doesn't wrap all create() or new builder calls; may skip CRC logic
• is caused by: HADOOP-15229 Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.
• relates to: HADOOP-14394 Provide Builder pattern for DistributedFileSystem.create
• relates to: HADOOP-14397 Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it