[CARBONDATA-2893] Job aborted during insert while loading the "Struct of Array" datatype values.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Environment: 3 Node ANT.
• Assignee: Unassigned
• Reporter: Prasanna Ravichandran
• Created: 27/Aug/18 13:09
• Updated: 30/Aug/18 12:13

Description

Job aborted during insert while loading the "Struct of Array" datatype values.

Test queries:

0: jdbc:hive2:> drop table if exists STRUCT_OF_ARRAY_com_hive;
---------+

Result

---------+
---------+
No rows selected (0.026 seconds)
0: jdbc:hive2:> create table STRUCT_OF_ARRAY_com_hive (CUST_ID string, YEAR int, MONTH int, AGE int, GENDER string, EDUCATED string, IS_MARRIED string, STRUCT_OF_ARRAY struct<ID: int,CHECK_DATE: string ,SNo: array<int>,sal1: array<float>,state: array<string>,date1: array<string>>,CARD_COUNT int,DEBIT_COUNT int, CREDIT_COUNT int, DEPOSIT float, HQ_DEPOSIT double) row format delimited fields terminated by ',' collection items terminated by '$' map keys terminated by '&';
---------+

Result

---------+
---------+
No rows selected (0.159 seconds)
0: jdbc:hive2:> load data local inpath '/opt/csv/complex/structofarray.csv' into table STRUCT_OF_ARRAY_com_hive;
---------+

Result

---------+
---------+
No rows selected (0.217 seconds)
0: jdbc:hive2:> drop table if exists STRUCT_OF_ARRAY_com;
---------+

Result

---------+
---------+
No rows selected (0.03 seconds)
0: jdbc:hive2:> create table STRUCT_OF_ARRAY_com (CUST_ID string, YEAR int, MONTH int, AGE int, GENDER string, EDUCATED string, IS_MARRIED string, STRUCT_OF_ARRAY struct<ID: int,CHECK_DATE: timestamp,SNo: array<int>,sal1: array<double>,state: array<string>,date1: array<timestamp>>,CARD_COUNT int,DEBIT_COUNT int, CREDIT_COUNT int, DEPOSIT double, HQ_DEPOSIT double) using carbon;
---------+

Result

---------+
---------+
No rows selected (0.099 seconds)
0: jdbc:hive2:> insert into STRUCT_OF_ARRAY_com select * from STRUCT_OF_ARRAY_com_hive;
Error: org.apache.spark.SparkException: Job aborted. (state=,code=0)

 

 Expected result:

Insert should be success.

Actual result:

Insert is showing job aborted.

 

Issue Links

• is related to: CARBONDATA-2872 Support standard spark's FIleFormat interface in carbon