[HADOOP-17999] No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 2.10.2, 3.3.2, 3.2.4
• Fix Version/s: 3.4.0, 2.10.2, 3.3.2, 3.2.4
• Component/s: viewfs
• Labels: pull-request-available
• Target Version/s: 3.4.0, 2.10.2, 3.3.2, 3.2.4
• Hadoop Flags: Reviewed
• Assignee: Abhishek Das
• Reporter: Abhishek Das
• Created: 09/Nov/21 06:38
• Updated: 11/Feb/24 23:14
• Resolved: 17/Nov/21 06:53

Description

Currently setVerifyChecksum and setWriteChecksum initializes all target file systems which causes delay in hadoop shell copy commands such as get, put, copyFromLocal etc.

This also eventually causes OOM.

Issue Links

• relates to: HDFS-15289 Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table
• links to: GitHub Pull Request #3639