[DRILL-1718] FLATTEN query returns "buffer is neither a method, a field, nor a member class..." error

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Fix Version/s: 0.8.0
• Component/s: Functions - Drill

Environment

0.7.0 snapshot on MacOSX in embedded mode

• Assignee: Chun Chang
• Reporter: Bob Rumsby
• Created: 15/Nov/14 02:27
• Updated: 28/Apr/15 22:24
• Resolved: 17/Jan/15 02:59

Description

A query with a FLATTEN function and a WHERE clause constraint on the flattened column fails.

0: jdbc:drill:zk=local> select name, flatten(categories) as categories from dfs.yelp.`yelp_academic_dataset_business.json` where categories='Pizza';
Query failed: Failure while running fragment., Line 68, Column 95: "buffer" is neither a method, a field, nor a member class of "org.apache.drill.exec.expr.holders.RepeatedVarCharHolder" [ 67016271-7266-4438-9529-d8330b1e39a4 on 10.250.0.28:31010 ]

Error: exception while executing query: Failure while executing query. (state=,code=0)
0: jdbc:drill:zk=local> explain plan for select name, flatten(categories) as categories from dfs.yelp.`yelp_academic_dataset_business.json` where categories='Pizza';
----------------------+

text

json

----------------------+

00-00 Screen 00-01 Project(name=[$1], categories=[$2]) 00-02 Flatten(flattenField=[$2]) 00-03 Project(EXPR$0=[$0], EXPR$1=[$1], EXPR$2=[$0]) 00-04 SelectionVectorRemover 00-05 Filter(condition=[=($0, 'Pizza')]) 00-06 Scan(groupscan=[EasyGroupScan [selectionRoot=/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json, numFiles=1, columns=[`categories`, `name`], files=file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json]])

{ "head" : Unknown macro: { "version" } , "graph" : [ { "pop" : "fs-scan", "@id" : 6, "files" : [ "file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json" ], "storage" : { "type" : "file", "enabled" : true, "connection" : "file:///", "workspaces" : Unknown macro: { "root" } , "formats" : Unknown macro: { "psv" } }, "format" : { "type" : "json" } , "columns" : [ "`categories`", "`name`" ], "selectionRoot" : "/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json", "cost" : 36382.0 }, { "pop" : "filter", "@id" : 5, "child" : 6, "expr" : "equal(`categories`, 'Pizza') ", "initialAllocation" : 1000000, "maxAllocation" : 10000000000, "cost" : 5457.3 } , { "pop" : "selection-vector-remover", "@id" : 4, "child" : 5, "initialAllocation" : 1000000, "maxAllocation" : 10000000000, "cost" : 5457.3 } , Unknown macro: { "pop" } , { "pop" : "flatten", "@id" : 2, "child" : 3, "column" : "`EXPR$2`", "initialAllocation" : 1000000, "maxAllocation" : 10000000000, "cost" : 5457.3 } , Unknown macro: { "pop" } , { "pop" : "screen", "@id" : 0, "child" : 1, "initialAllocation" : 1000000, "maxAllocation" : 10000000000, "cost" : 5457.3 } ] }

----------------------+
1 row selected (0.115 seconds)
0: jdbc:drill:zk=local>