[IMPALA-3060] Supports IS [NOT] NULL feature for complex types

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 2.3.0, Impala 2.5.0
• Component/s: Frontend
• Labels: catalog-server complextype impala
• Environment: CDH 5.5.1
• Epic Link: UDF support for complex types
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Petter von Dolwitz
• Created: 23/Feb/16 13:01
• Updated: 17/Mar/20 11:40

Description

The IS NULL / IS NOT NULL operator does not seem to work on structs. This functionality is vital when working with "wide" tables.

Sample query to reproduce (col2 defined as STRUCT<field:STRING>):

SELECT
col1
FROM
my_table
WHERE
col2 IS NOT NULL;

Output:

I0223 12:54:45.090255 19314 Frontend.java:895] create plan
I0223 12:54:45.091451 19314 jni-util.cc:177] java.lang.IllegalStateException: getSlotSize() not implemented for type STRUCT<field:STRING>
at com.cloudera.impala.catalog.Type.getSlotSize(Type.java:218)
at com.cloudera.impala.analysis.TupleDescriptor.computeMemLayout(TupleDescriptor.java:211)
at com.cloudera.impala.planner.PlanNode.computeMemLayout(PlanNode.java:479)
at com.cloudera.impala.planner.HdfsScanNode.init(HdfsScanNode.java:163)
at com.cloudera.impala.planner.SingleNodePlanner.createScanNode(SingleNodePlanner.java:1222)
at com.cloudera.impala.planner.SingleNodePlanner.createTableRefNode(SingleNodePlanner.java:1444)
at com.cloudera.impala.planner.SingleNodePlanner.createTableRefsPlan(SingleNodePlanner.java:791)
at com.cloudera.impala.planner.SingleNodePlanner.createSelectPlan(SingleNodePlanner.java:630)
at com.cloudera.impala.planner.SingleNodePlanner.createQueryPlan(SingleNodePlanner.java:229)
at com.cloudera.impala.planner.SingleNodePlanner.createSingleNodePlan(SingleNodePlanner.java:135)
at com.cloudera.impala.planner.Planner.createPlan(Planner.java:58)
at com.cloudera.impala.service.Frontend.createExecRequest(Frontend.java:897)
at com.cloudera.impala.service.JniFrontend.createExecRequest(JniFrontend.java:147)

Issue Links

• relates to: IMPALA-3111 Selecting collection types returns json output rather than analysis error
• relates to: IMPALA-2288 IllegalStateException when ordering by struct field