Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-644

Select query fails randomly on spark shell

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.0.0-incubating
    • Fix Version/s: 1.0.0-incubating
    • Component/s: data-query
    • Labels:
      None
    • Environment:
      spark 1.6.2

      Description

      I created a carbon table and loaded it with data(csv attached) via spark shell by running the below command from $SPARK_HOME/bin :
      ./spark-shell
      and then to get the carbon context :
      import org.apache.spark.sql.CarbonContext;
      val cc = new CarbonContext(sc);

      CREATE AND LOAD COMMANDS:

      scala>cc.sql("CREATE TABLE connectdemo1 (name String, gender String, province String , singler String, age Int) STORED BY 'org.apache.carbondata.format'");

      scala>cc.sql("LOAD DATA inpath 'hdfs://localhost:54310/BabuStore/Data/uniqdata/connectdemo1.csv' INTO table connectdemo1 options('DELIMITER'=',','FILEHEADER'='name, gender, province, singler, age')");

      The above two operations were successful but when I tried to run the select query, it failed giving me the java.io.FileNotFoundException(see the log attached)

      scala> cc.sql("select * from connectdemo1").show();

        Attachments

        1. connectdemo1.csv
          0.7 kB
          Deepti Bhardwaj
        2. eror-log-while-select
          9 kB
          Deepti Bhardwaj

          Activity

            People

            • Assignee:
              ravi.pesala Ravindra Pesala
              Reporter:
              deeptibhardwaj24 Deepti Bhardwaj
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: