[DRILL-2853] AssertionError: Internal error: while converting `KVGEN`(*)

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Fix Version/s: Future
• Component/s: Execution - Flow

Environment

64e3ec52b93e9331aa5179e040eca19afece8317 | DRILL-2611: value vectors should report valid value count | 16.04.2015 @ 13:53:34 EDT

• Assignee: Unassigned
• Reporter: Khurram Faraaz
• Created: 23/Apr/15 06:55
• Updated: 18/Nov/15 19:34

Description

I am seeing an assertion error in the below query that uses KVGEN function. Data in the JSON file was,

0: jdbc:drill:> select * from `kvgenData.json`;
+------------+------------+------------+------------+------------+------------+
|    eid     |   ename    |    eage    |  empDept   | empSalary  |  empPhone  |
+------------+------------+------------+------------+------------+------------+
| 12345      | MR WRIGHT  | null       | null       | null       | null       |
| null       | null       | 45         | HR         | null       | null       |
| null       | null       | null       | null       | 50000      | 123-456-6789 |
+------------+------------+------------+------------+------------+------------+
3 rows selected (0.185 seconds)

Failing query

0: jdbc:drill:> select kvgen(*) from `kvgenData.json`;
Query failed: SYSTEM ERROR: Unexpected exception during fragment initialization: Internal error: while converting `KVGEN`(*)

[13b9f79f-6f24-43d4-9119-2cdae441895f on centos-02.qa.lab:31010]

Error: exception while executing query: Failure while executing query. (state=,code=0)

Stack trace from drillbit.log

2015-04-23 06:42:15,807 [2ac76bb7-e392-bb0b-c5e3-91dfa98b2c94:foreman] INFO  o.a.drill.exec.work.foreman.Foreman - State change requested.  PENDING --> FAILED
org.apache.drill.exec.work.foreman.ForemanException: Unexpected exception during fragment initialization: Internal error: while converting `KVGEN`(*)
        at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:211) [drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
Caused by: java.lang.AssertionError: Internal error: while converting `KVGEN`(*)
        at org.eigenbase.util.Util.newInternal(Util.java:750) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.ReflectiveConvertletTable$2.convertCall(ReflectiveConvertletTable.java:149) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlNodeToRexConverterImpl.convertCall(SqlNodeToRexConverterImpl.java:52) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter$Blackboard.visit(SqlToRelConverter.java:4099) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter$Blackboard.visit(SqlToRelConverter.java:3485) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql.SqlCall.accept(SqlCall.java:125) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter$Blackboard.convertExpression(SqlToRelConverter.java:3994) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter.convertSelectList(SqlToRelConverter.java:3301) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter.convertSelectImpl(SqlToRelConverter.java:519) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter.convertSelect(SqlToRelConverter.java:474) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter.convertQueryRecursive(SqlToRelConverter.java:2657) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:432) ~[optiq-core-0.9-drill-r21.jar:na]
        at net.hydromatic.optiq.prepare.PlannerImpl.convert(PlannerImpl.java:190) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToRel(DefaultSqlHandler.java:166) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
        at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:133) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
        at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:155) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
        at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:770) [drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
        at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:202) [drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
        ... 3 common frames omitted
Caused by: java.lang.reflect.InvocationTargetException: null
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_75]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.7.0_75]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_75]
        at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_75]
        at org.eigenbase.sql2rel.ReflectiveConvertletTable$2.convertCall(ReflectiveConvertletTable.java:139) ~[optiq-core-0.9-drill-r21.jar:na]
        ... 19 common frames omitted
Caused by: java.lang.AssertionError: Internal error: invariant violated: conversion result not null
        at org.eigenbase.util.Util.newInternal(Util.java:735) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.util.Util.permAssert(Util.java:843) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.SqlToRelConverter$Blackboard.convertExpression(SqlToRelConverter.java:3995) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.StandardConvertletTable.convertExpressionList(StandardConvertletTable.java:731) ~[optiq-core-0.9-drill-r21.jar:na]
        at org.eigenbase.sql2rel.StandardConvertletTable.convertFunction(StandardConvertletTable.java:593) ~[optiq-core-0.9-drill-r21.jar:na]
        ... 24 common frames omitted

Issue Links

• is duplicated by: DRILL-4102 Only one row found in a JSON document that contains multiple items.