Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-590

unusual behaviour of using carbonthrift server with spark 2.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.0.0-incubating
    • None
    • build
    • None
    • Spark 2.0

    Description

      have a look at these logs

      started thrift server

      ./bin/spark-submit --conf spark.sql.hive.thriftServer.singleSession=true --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer $SPARK_HOME/carbonlib/carbondata_2.11-1.0.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar hdfs://localhost:54310/opt/carbonStore

      logs

      INFO 04-01 12:46:55,421 - Service:ThriftBinaryCLIService is started.
      INFO 04-01 12:46:55,421 - Service:HiveServer2 is started.

      started beeline
      connected to thrift server

      !connect jdbc:hive2://localhost:10000

      executed the query

      CREATE TABLE Bug212(int string)USING org.apache.spark.sql.CarbonSource
      OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t100");

      Error:
      org.apache.carbondata.spark.exception.MalformedCarbonCommandException: Table
      default.t 100 can not be created without key columns. Please use
      DICTIONARY_INCLUDE or DICTIONARY_EXCLUDE to set at least one key column if
      all specified columns are numeric types (state=,code=0)

      2 minutes later

      CREATE TABLE Bug211(int int)USING org.apache.spark.sql.CarbonSource
      OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t 100");

      ---------+

      Result

      ---------+
      ---------+
      No rows selected (0.212 seconds)

      Attachments

        Activity

          People

            Unassigned Unassigned
            anubhavtarar anubhav tarar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: