Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22601

Data load is getting displayed successful on providing non existing hdfs file path

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.2.2
    • Component/s: Spark Core
    • Labels:
      None

      Description

      Data load is getting displayed successful on providing non existing hdfs file path where as in local path proper error message is getting displayed

      create table tb2 (a string, b int);
      load data inpath 'hdfs://hacluster/data1.csv' into table tb2
      Note: data1.csv does not exist in HDFS

      when local non existing file path is given below error message will be displayed
      "LOAD DATA input path does not exist". attached snapshots of behaviour in spark 2.1 and spark 2.2 version

        Attachments

          Activity

            People

            • Assignee:
              S71955 Sujith Chacko
              Reporter:
              S71955 Sujith Chacko

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment