Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
1.1.0
-
None
-
None
-
HDP sandbox 2.5, Spark 1.6.2
Description
While trying to load data into Carabondata table using dataframe, the columns containing commas are not properly loaded.
Eg:
scala> df.show(false)
---------------------------------------------+
Country | Branch | Name | Address | ShortName | Status |
---------------------------------------------+
2 | 1 | Main Branch | XXXX, Dubai, UAE | UHO | 256 |
---------------------------------------------+
scala> df.write.format("carbondata").option("tableName", "Branch1").option("compress", "true").mode(SaveMode.Overwrite).save()
scala> cc.sql("select * from branch1").show(false)
------------------------------------+
country | branch | name | address | shortname | status |
------------------------------------+
2 | 1 | Main Branch | XXXX | Dubai | null |
------------------------------------+