[DRILL-4459] SchemaChangeException while querying hive json table

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.7.0
• Component/s: Functions - Drill, Functions - Hive

Environment

MapR-Drill 1.4.0
Hive-1.2.0

• Assignee: Vitalii Diravka
• Reporter: Vitalii Diravka
• Reviewer: Krystal
• Created: 01/Mar/16 14:38
• Updated: 12/May/16 18:09
• Resolved: 20/Apr/16 12:25

Description

getting the SchemaChangeException while querying json documents stored in hive table.

Error: SYSTEM ERROR: SchemaChangeException: Failure while trying to materialize incoming schema.  Errors:
 
Error in expression at index -1.  Error: Missing function implementation: [castBIT(VAR16CHAR-OPTIONAL)].  Full expression: --UNKNOWN EXPRESSION--..

minimum reproduce

created sample json documents using the attached script(randomdata.sh)
hive>create table simplejson(json string);
hive>load data local inpath '/tmp/simple.json' into table simplejson;
now query it through Drill.
Drill Version
select * from sys.version;
+-----------+----------------+-------------+-------------+------------+
| commit_id | commit_message | commit_time | build_email | build_time |
+-----------+----------------+-------------+-------------+------------+
| eafe0a245a0d4c0234bfbead10c6b2d7c8ef413d | DRILL-3901:  Don't do early expansion of directory in the non-metadata-cache case because it already happens during ParquetGroupScan's metadata gathering operation. | 07.10.2015 @ 17:12:57 UTC | Unknown | 07.10.2015 @ 17:36:16 UTC |
+-----------+----------------+-------------+-------------+------------+

0: jdbc:drill:zk=> select * from hive.`default`.simplejson where GET_JSON_OBJECT(simplejson.json, '$.DocId') = 'DocId2759947' limit 1;
Error: SYSTEM ERROR: SchemaChangeException: Failure while trying to materialize incoming schema.  Errors:
 
Error in expression at index -1.  Error: Missing function implementation: [castBIT(VAR16CHAR-OPTIONAL)].  Full expression: --UNKNOWN EXPRESSION--..

Fragment 1:1

[Error Id: 74f054a8-6f1d-4ddd-9064-3939fcc82647 on ip-10-0-0-233:31010] (state=,code=0)