[CARBONDATA-738] Able to load dataframe with boolean type in a carbon table but with null values

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.0.0-incubating
• Fix Version/s: 1.1.0
• Component/s: spark-integration
• Environment: spark 1.6,spark 2.1
• Assignee: anubhav tarar
• Reporter: anubhav tarar
• Created: 02/Mar/17 10:04
• Updated: 05/Apr/17 10:45
• Resolved: 03/Mar/17 07:23

Description

i created a dataframe with boolean type as follows

case class People(name: String, occupation: String, consultant: Boolean)

val people = List(People("sangeeta", "engineer", true), People("pallavi", "consultant", true))
val peopleRDD: RDD[People] = cc.sc.parallelize(people)
val peopleDF: DataFrame = peopleRDD.toDF("name", "occupation", "id")

peopleDF.write
.format("carbondata")
.option("tableName", "carbon2")
.option("compress", "true")
.mode(SaveMode.Overwrite)
.save()

cc.sql("SELECT * FROM carbon2").show()

currently boolean type is not supported in carbon data but table gets created

but it shows me null values

------------------

name

occupation

id

------------------

pallavi	consultant	null
sangeeta	engineer	null

------------------

for boolean type it should throw unsupported type exception

there is problem with carbondataframe writer

Issue Links

• links to: GitHub Pull Request #621