[CARBONDATA-2228] Exception is Masked Inside StandardPartitionTableQueryTestCase

• Type: Improvement
• Status: Open
• Priority: Trivial
• Resolution: Unresolved
• Affects Version/s: 1.4.0
• Component/s: test
• Assignee: anubhav tarar
• Reporter: anubhav tarar
• Created: 06/Mar/18 06:37
• Updated: 06/Mar/18 06:37

Description

Inside This test case exception from both spark version is different and it is masked

test("Creation of partition table should fail if the colname in table schema and partition column is same even if both are case sensitive"){
intercept[Exception]

{ sql("CREATE TABLE uniqdata_char2(name char,id int) partitioned by (NAME char)stored by 'carbondata' ") }

}

 

for spark 2.1 exception message is 

Operation not allowed: Partition columns should not be specified in the schema: name")

 

but for spark 2.2 it is 

DataType char is not supported"

 

reason for different exception in different spark version is 

spark 2.1.0 supports creating table even if char data type is given with out digits

scala> spark.sql("create table id(id char)");
18/02/23 14:12:23 WARN HiveMetaStore: Location: file:/home/anubhav/Documents/phatak/spark-2.1/bin/spark-warehouse/id specified for non-external table:id
res0: org.apache.spark.sql.DataFrame = []

but not in spark 2.2.1

scala> spark.sql("create table id(id char)");
18/02/23 14:22:05 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
org.apache.spark.sql.catalyst.parser.ParseException:
DataType char is not supported.(line 1, pos 19)

 

Solution: assert the different exception for different spark version when char data type does not have digit