[IMPALA-2844] Select count(*) from RCFileTable throw NotImplementedException in Impala 2.3.0

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.3.0
• Fix Version/s: Impala 2.5.0, Impala 2.3.4
• Component/s: Frontend
• Labels: usability
• Target Version: Impala 2.5.0, Impala 2.3.4
• Assignee: Alexander Behm
• Reporter: Juan Yu
• Created: 13/Jan/16 18:03
• Updated: 12/Apr/16 02:03
• Resolved: 22/Feb/16 16:27

Description

This is a table using RCFile with complex type like "ARRAY<BIGINT>", "ARRAY<STRING>". The select count query used to work on Impala 2.2 version, but it throws exceptions in 2.3
"ERROR: NotImplementedException: Scan of table 'default.badgzip' in format 'RC_FILE' is not supported because the table has a column 'addr_ids' with a complex type 'ARRAY<BIGINT>'.
Complex types are supported for these file formats: AVRO, PARQUET."

Although Impala doesn't support complex type in RC_FILE, select count should work and it works in Impala 2.2. this is a behavior regression.

another issue, does Impala fully support complex type for AVRO? If not, we should remove "AVRO" from the error message.