[HIVE-25859] load_non_hdfs_path.q fails on master: .1.txt.crc does not exist

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Ayush Saxena
• Reporter: László Bodor
• Created: 11/Jan/22 09:14
• Updated: 17/Nov/22 08:48
• Resolved: 23/Jan/22 15:23

Description

repro

 mvn clean install -Dtest.output.overwrite=true -Pitests,hadoop-2 -Denforcer.skip=true -pl itests/qtest -pl itests/util -am -Dtest=TestMiniLlapLocalCliDriver -Dqfile=load_non_hdfs_path.q

Caused by: java.io.FileNotFoundException: File file:/Users/laszlobodor/apache/hive/itests/qtest/target/tmp/non_hdfs_path/.1.txt.crc does not exist
	at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:641)
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:930)
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:631)
	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:454)
	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:146)
	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347)
	at org.apache.hadoop.fs.FilterFileSystem.open(FilterFileSystem.java:164)
	at org.apache.hadoop.fs.ProxyFileSystem.open(ProxyFileSystem.java:153)
	at org.apache.hadoop.fs.FilterFileSystem.open(FilterFileSystem.java:164)
	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950)
	at org.apache.hadoop.hive.common.FileUtils.copy(FileUtils.java:695)
	at org.apache.hadoop.hive.common.FileUtils.copy(FileUtils.java:685)
	at org.apache.hadoop.hive.common.FileUtils.copy(FileUtils.java:667)
	at org.apache.hadoop.hive.common.FileUtils.copy(FileUtils.java:634)
	at org.apache.hadoop.hive.ql.metadata.Hive.moveFile(Hive.java:4809)
	... 64 more

Issue Links

• is caused by: HIVE-25609 Preserve XAttrs in normal file copy case.
• links to: GitHub Pull Request #2939