[SPARK-22601] Data load is getting displayed successful on providing non existing hdfs file path

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.2
• Component/s: Spark Core
• Assignee: Sujith Chacko
• Reporter: Sujith Chacko
• Created: 24/Nov/17 12:57
• Updated: 22/Mar/19 07:33
• Resolved: 16/Oct/18 04:18

Description

Data load is getting displayed successful on providing non existing hdfs file path where as in local path proper error message is getting displayed

create table tb2 (a string, b int);
load data inpath 'hdfs://hacluster/data1.csv' into table tb2
Note: data1.csv does not exist in HDFS

when local non existing file path is given below error message will be displayed
"LOAD DATA input path does not exist". attached snapshots of behaviour in spark 2.1 and spark 2.2 version

Issue Links

• links to: [Github] Pull Request #19823 (sujith71955)