[CARBONDATA-836] Error in load using dataframe - columns containing comma

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Component/s: spark-integration
• Environment: HDP sandbox 2.5, Spark 1.6.2
• Assignee: Sanoj MG
• Reporter: Sanoj MG
• Created: 30/Mar/17 08:13
• Updated: 07/Jul/17 00:08

Description

While trying to load data into Carabondata table using dataframe, the columns containing commas are not properly loaded.

Eg:
scala> df.show(false)
---------------------------------------------+

Country

Branch

Name

Address

ShortName

Status

---------------------------------------------+

2

1

Main Branch

XXXX, Dubai, UAE

UHO

256

---------------------------------------------+

scala> df.write.format("carbondata").option("tableName", "Branch1").option("compress", "true").mode(SaveMode.Overwrite).save()

scala> cc.sql("select * from branch1").show(false)

------------------------------------+

country

branch

name

address

shortname

status

------------------------------------+

2

1

Main Branch

XXXX

Dubai

null

------------------------------------+