Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-644

Select query fails randomly on spark shell

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.0.0-incubating
    • 1.0.0-incubating
    • data-query
    • None
    • spark 1.6.2

    Description

      I created a carbon table and loaded it with data(csv attached) via spark shell by running the below command from $SPARK_HOME/bin :
      ./spark-shell
      and then to get the carbon context :
      import org.apache.spark.sql.CarbonContext;
      val cc = new CarbonContext(sc);

      CREATE AND LOAD COMMANDS:

      scala>cc.sql("CREATE TABLE connectdemo1 (name String, gender String, province String , singler String, age Int) STORED BY 'org.apache.carbondata.format'");

      scala>cc.sql("LOAD DATA inpath 'hdfs://localhost:54310/BabuStore/Data/uniqdata/connectdemo1.csv' INTO table connectdemo1 options('DELIMITER'=',','FILEHEADER'='name, gender, province, singler, age')");

      The above two operations were successful but when I tried to run the select query, it failed giving me the java.io.FileNotFoundException(see the log attached)

      scala> cc.sql("select * from connectdemo1").show();

      Attachments

        1. eror-log-while-select
          9 kB
          Deepti Bhardwaj
        2. connectdemo1.csv
          0.7 kB
          Deepti Bhardwaj

        Activity

          People

            ravi.pesala Ravindra Pesala
            deeptibhardwaj24 Deepti Bhardwaj
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: