[DRILL-1749] Flatten does not work with nested maps/unions.

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.6.0, 0.7.0
• Fix Version/s: 0.7.0
• Component/s: Functions - Drill
• Assignee: Jason Altekruse
• Reporter: Hao Zhu
• Created: 19/Nov/14 18:37
• Updated: 29/Apr/15 15:24
• Resolved: 30/Nov/14 19:37

Description

Minimum reproduce :

test1.json
 {"data":
     [{"key":"apple","value":{"cnt":1}}, {"key":"orange","value":{"cnt":2}}]
 }
 select flatten(data) from dfs.tmp.`test1.json` as t;
+------------+
|   EXPR$0   |
+------------+
Query failed: Failure while running fragment.[ 7e60b3fe-198d-4bc5-b440-e6f7a15cc54f on n3a:31010 ]
  (java.lang.UnsupportedOperationException) 
    org.apache.drill.exec.vector.complex.MapVector$MapTransferPair.splitAndTransfer():284
    org.apache.drill.exec.vector.complex.RepeatedMapVector$SingleMapTransferPair.splitAndTransfer():305
    org.apache.drill.exec.test.generated.FlattenerGen80.flattenRecords():106

    org.apache.drill.exec.physical.impl.flatten.FlattenRecordBatch.doWork():155
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():89
    org.apache.drill.exec.physical.impl.flatten.FlattenRecordBatch.innerNext():121
    org.apache.drill.exec.record.AbstractRecordBatch.next():106
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():124
    org.apache.drill.exec.record.AbstractRecordBatch.next():86
    org.apache.drill.exec.record.AbstractRecordBatch.next():76
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():52
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():129
    org.apache.drill.exec.record.AbstractRecordBatch.next():106
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():124
    org.apache.drill.exec.physical.impl.BaseRootExec.next():67
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():122
    org.apache.drill.exec.physical.impl.BaseRootExec.next():57
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():113
    org.apache.drill.exec.work.WorkManager$RunnableWrapper.run():249
    .......():0

java.lang.RuntimeException: java.sql.SQLException: Failure while executing query.
	at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
	at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
	at sqlline.SqlLine.print(SqlLine.java:1809)
	at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
	at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
	at sqlline.SqlLine.dispatch(SqlLine.java:889)
	at sqlline.SqlLine.begin(SqlLine.java:763)
	at sqlline.SqlLine.start(SqlLine.java:498)
	at sqlline.SqlLine.main(SqlLine.java:460)