[DRILL-3444] Implement Is Not Null/Is Null on List of objects - [isnotnull(MAP-REPEATED)] error

• Type: Improvement
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Fix Version/s: Future
• Component/s: Execution - Data Types, Functions - Drill

Environment

Drill 1.0

• Assignee: Mehant Baid
• Reporter: Tugdual Grall
• Created: 01/Jul/15 09:43
• Updated: 19/Jun/17 00:52

Description

It is not possble to use the IS NULL / IS NOT NULL operator on an attribuite that contains a list of "object". (it is working with a list of scalar types)

Query:

select *
from dfs.`/working/json_array/*.json` p
where p.tags IS NOT NULL

Document:

{
  "name" : "PPRODUCT_002",
  "price" : 200.00,
  "tags" : [ { "type" : "sports" } , { "type" : "ocean" }]
}

Error:

org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: org.apache.drill.exec.exception.SchemaChangeException: Failure while trying to materialize incoming schema. Errors: Error in expression at index -1. Error: Missing function implementation: [isnotnull(MAP-REPEATED)]. Full expression: --UNKNOWN EXPRESSION--.. Fragment 0:0 [Error Id: 384e6b86-ce17-4eb9-b5eb-27870a341c90 on 192.168.99.13:31010]

Workaround:
By using a sub element it is working, for example:

select *
from dfs.`/Users/tgrall/working/json_array/*.json` p
where p.tags.type IS NULL

Issue Links

• is related to: DRILL-4824 Null maps / lists and non-provided state support for JSON fields. Numeric types promotion.