Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.1.0
-
None
-
None
-
spark:1.6.0,mysql hive metastore
Description
i am use carbondata version is 1.1.0 and spark version is 1.6.0.
and I reproduce in accordance with the official quick-start-guide case
again,
1.Creating a Table
cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name
String,city String,age int) stored by 'carbondata' ")
2.load data into table
cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
table carbondb.test_table")
3.start carbonthriftserver
/home/zz/spark-1.6.0-bin-hadoop2.6/bin/spark-submit --master local[*]
--driver-java-options="-Dcarbon.properties.filepath=/home/zz/spark-1.6.0-bin-hadoop2.6/conf/carbon.properties"
--executor-memory 4G --driver-memory 2g --conf
spark.serializer=org.apache.spark.serializer.KryoSerializer --conf
"spark.sql.shuffle.partitions=3" --conf spark.speculation=true --class
org.apache.carbondata.spark.thriftserver.CarbonThriftServer
/home/zz/spark-1.6.0-bin-hadoop2.6/carbonlib/carbondata_2.10-1.1.0-shade-hadoop2.2.0.jar
hdfs://nameservice1/user/zz/rp_carbon_store
4.Connecting to CarbonData Thrift Server Using Beeline.
<http://chuantu.biz/t6/47/1505284993x2890202558.jpg>
5.drop table
cc.sql("drop table carbondb.test_table")
6.recreate table and load data
cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name
String,city String,age int) stored by 'carbondata' ")
cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
table carbondb.test_table")
7.select data use beeline
<http://chuantu.biz/t6/47/1505284937x1034817476.jpg>
Like the above error, the cache is not updated
in my case,1,2,5 and 6 step is one session on spark-shell ,4 and 7 is
one session on beeline,
and i test this case on the current carbondata master branch(1.2.0),
when i use beeline there is no Btree load failed info,but in my table there
is no data,All the data is null,but in spark-shell is ok.
spark-shell:
-------------+
| id | name | city | age |
-------------+
| 1 | david | shenzhen | 31 |
| 2 | eason | shenzhen | 27 |
| 3 | jarry | wuhan | 35 |
-------------+
beeline:
0: jdbc:hive2://localhost:10000> select * from carbondb.test_table;
----------------------
| id | name | city | age |
----------------------
| NULL | NULL | NULL | NULL |
| NULL | NULL | NULL | NULL |
| NULL | NULL | NULL | NULL |
----------------------
Attachments
Issue Links
- links to
