[HIVE-17370] Some tests are failing with java.io.FileNotFoundException: File file:/tmp/hadoop/mapred/...

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.0.0
• Fix Version/s: 4.0.0-alpha-2
• Assignee: Peter Vary Assign to me
• Reporter: Peter Vary
• Created: 22/Aug/17 14:53
• Updated: 16/Nov/22 13:50
• Resolved: 22/May/18 15:31

Description

Mostly independently of the given tests, I found this flakiness in several tests:

2017-08-21T06:34:26,916  WARN [Thread-7815] mapred.LocalJobRunner: job_local245886038_0060
java.io.FileNotFoundException: File file:/tmp/hadoop/mapred/staging/hiveptest245886038/.staging/job_local245886038_0060/job.splitmetainfo does not exist
	at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:635) ~[hadoop-common-2.8.0.jar:?]
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:861) ~[hadoop-common-2.8.0.jar:?]
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:625) ~[hadoop-common-2.8.0.jar:?]
	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:435) ~[hadoop-common-2.8.0.jar:?]
	at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(SplitMetaInfoReader.java:51) ~[hadoop-mapreduce-client-core-2.8.0.jar:?]
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:534) [hadoop-mapreduce-client-common-2.8.0.jar:?]

One example is:
https://builds.apache.org/job/PreCommit-HIVE-Build/6469/testReport/org.apache.hadoop.hive.cli/TestAccumuloCliDriver/testCliDriver_accumulo_queries_/

Issue Links

• duplicates: HIVE-19626 Change tmp staging mapred directory for CliDriver