Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-959

Unable to query carbon table with complex data type on hive

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 1.0.0-incubating
    • None
    • hive-integration
    • None
    • hive1.2.1,spark 2.1

    Description

      started the spark shell
      created carbon table with complex type

      carbon.sql("create table complextypes(id string,MAC array<string>) stored by 'carbondata' ")

      carbon.sql("""LOAD DATA INPATH 'hdfs://localhost:54310/newdata.csv' into table complextypes""")

      start hive shell

      create table complex(id string,mac array<string>);
      OK

      alter table complextype set FILEFORMAT
      > INPUTFORMAT "org.apache.carbondata.hive.MapredCarbonInputFormat"
      > OUTPUTFORMAT "org.apache.carbondata.hive.MapredCarbonOutputFormat"
      > SERDE "org.apache.carbondata.hive.CarbonHiveSerDe";

      alter table complex set LOCATION 'hdfs://localhost:54310/opt/carbonStore/default/complextypes' ;

      query the data

      hive> select * from complex;
      OK
      Failed with exception java.io.IOException:java.lang.NullPointerException
      Time taken: 2.05 seconds

      Attachments

        1. newdata.csv
          0.0 kB
          anubhav tarar

        Activity

          People

            anubhavtarar anubhav tarar
            anubhavtarar anubhav tarar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: