[HIVE-12365] Added resource path is sent to cluster as an empty string when externally removed

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.1
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: Hive
• Assignee: Chaoyu Tang
• Reporter: Chaoyu Tang
• Created: 07/Nov/15 15:30
• Updated: 16/Feb/16 23:50
• Resolved: 11/Nov/15 23:54

Description

Sometimes the resources (e.g. jar) added via command like "add jars <filepath>" are removed externally from their filepath for some reasons. Their paths are sent to cluster as empty strings which causes the failures to the query that even do not need these jars in execution. The error look like as following:

15/11/06 21:56:44 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-ctang/mapred/staging/ctang734817191/.staging/job_local734817191_0003
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
	at org.apache.hadoop.fs.Path.<init>(Path.java:135)
	at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:215)
	at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:390)
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:483)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)