[HADOOP-14630] Contract Tests to verify create, mkdirs and rename under a file is forbidden

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.9.0
• Fix Version/s: 3.3.0
• Component/s: fs, fs/azure, fs/s3, fs/swift
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 07/Jul/17 14:25
• Updated: 09/Mar/20 17:06
• Resolved: 09/Mar/20 14:46

Description

Object stores can get into trouble in ways which an FS would never, do, ways so obvious we've never done tests for them. We know what the problems are: test for file and dir creation directly/indirectly under other files

• mkdir(file/file)
• mkdir(file/subdir)
• dir under file/subdir/subdir
• dir/dir2/file, verify dir & dir2 exist
• dir/dir2/dir3, verify dir & dir2 exist
• rename(src, file/dest)
• rename(src, file/dir/dest)

Issue Links

• incorporates: HDFS-12101 DFSClient.rename() to unwrap ParentNotDirectoryException; define policy for renames under a file
• is depended upon by: HADOOP-16829 Über-jira: S3A Hadoop 3.3.1 features
• is related to: DRILL-5733 Unable to SELECT from parquet file with Hadoop 2.7.4
• relates to: HADOOP-16911 S3A mkdirs to indicate which parent path element refers to a file
• relates to: HADOOP-14457 create() does not notify metadataStore of parent directories or ensure they're not existing files
• links to: GitHub Pull Request #533