Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3060

Supports IS [NOT] NULL feature for complex types

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.3.0, Impala 2.5.0
    • Fix Version/s: None
    • Component/s: Frontend
    • Environment:
      CDH 5.5.1

      Description

      The IS NULL / IS NOT NULL operator does not seem to work on structs. This functionality is vital when working with "wide" tables.

      Sample query to reproduce (col2 defined as STRUCT<field:STRING>):

      SELECT
      col1
      FROM
      my_table
      WHERE
      col2 IS NOT NULL;

      Output:

      I0223 12:54:45.090255 19314 Frontend.java:895] create plan
      I0223 12:54:45.091451 19314 jni-util.cc:177] java.lang.IllegalStateException: getSlotSize() not implemented for type STRUCT<field:STRING>
      at com.cloudera.impala.catalog.Type.getSlotSize(Type.java:218)
      at com.cloudera.impala.analysis.TupleDescriptor.computeMemLayout(TupleDescriptor.java:211)
      at com.cloudera.impala.planner.PlanNode.computeMemLayout(PlanNode.java:479)
      at com.cloudera.impala.planner.HdfsScanNode.init(HdfsScanNode.java:163)
      at com.cloudera.impala.planner.SingleNodePlanner.createScanNode(SingleNodePlanner.java:1222)
      at com.cloudera.impala.planner.SingleNodePlanner.createTableRefNode(SingleNodePlanner.java:1444)
      at com.cloudera.impala.planner.SingleNodePlanner.createTableRefsPlan(SingleNodePlanner.java:791)
      at com.cloudera.impala.planner.SingleNodePlanner.createSelectPlan(SingleNodePlanner.java:630)
      at com.cloudera.impala.planner.SingleNodePlanner.createQueryPlan(SingleNodePlanner.java:229)
      at com.cloudera.impala.planner.SingleNodePlanner.createSingleNodePlan(SingleNodePlanner.java:135)
      at com.cloudera.impala.planner.Planner.createPlan(Planner.java:58)
      at com.cloudera.impala.service.Frontend.createExecRequest(Frontend.java:897)
      at com.cloudera.impala.service.JniFrontend.createExecRequest(JniFrontend.java:147)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Pettax Petter von Dolwitz
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: