[CARBONDATA-3643] Insert array('')/array() into Struct<Array> column will result in array(null), which is inconsist with Parquet

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.6.1, 2.0.0
• Assignee: Unassigned
• Reporter: Xingjun Hao
• Created: 31/Dec/19 03:57
• Updated: 06/Jul/21 06:56

Description

 

//
sql("create table datatype_struct_parquet(price struct<b:array<string>>) stored as parquet") 
sql("insert into table datatype_struct_parquet values(named_struct('b', array('')))") 
sql("create table datatype_struct_carbondata(price struct<b:array<string>>) stored as carbondata") 
sql("insert into datatype_struct_carbondata select * from datatype_struct_parquet")

checkAnswer( sql("SELECT * FROM datatype_struct_carbondata"), sql("SELECT * FROM datatype_struct_parquet"))

!== Correct Answer - 1 == == Spark Answer - 1 == 
![[WrappedArray()]] [[WrappedArray(null)]]