[IMPALA-12845] Crash with DESCRIBE on a complex type from an Iceberg table

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Epic Color: ghx-label-1
• Assignee: Daniel Becker
• Reporter: Daniel Becker
• Created: 27/Feb/24 11:07
• Updated: 10/Mar/24 01:29
• Resolved: 10/Mar/24 01:29

Description

A DESCRIBE statement on a struct contained in an Iceberg table crashes Impala:

In Hive:

create table ice_struct (id INT, s STRUCT<i: INT>) stored by iceberg;

In Impala:

describe ice_struct.s
Caught exception TSocket read 0 bytes, type=<class 'thrift.transport.TTransport.TTransportException'> in FetchResults. 
Error communicating with impalad: TSocket read 0 bytes

The logs in impalad.FATAL indicate that we hit a DCHECK:

F0227 11:53:49.936864 680819 query-result-set.cc:386] Check failed: num_col == metadata_.columns.size() (3 vs. 4)

 

Note that this also happens with Iceberg metadata tables, for example:

describe functional_parquet.iceberg_query_metadata.entries.readable_metrics;

With non-Iceberg tables there is no error.

Issue Links

• is related to: IMPALA-10947 SQL support for querying Iceberg metadata