[DRILL-539] order by query on hive avro table fails

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: Query Planning & Optimization
• Assignee: Ramana Inukonda Nagaraj
• Reporter: Ramana Inukonda Nagaraj
• Created: 17/Apr/14 18:33
• Updated: 11/Aug/14 21:53
• Resolved: 11/Aug/14 21:53

Description

hive> desc doctors;
OK
number int from deserializer
first_name string from deserializer
last_name string from deserializer
Time taken: 0.101 seconds, Fetched: 3 row(s)

0: jdbc:drill:schema=dfs> SELECT first_name FROM doctors;
works.

0: jdbc:drill:schema=dfs> SELECT first_name FROM doctors ORDER BY `number`;

org.eigenbase.relopt.RelOptPlanner$CannotPlanException: Node rel#301:Subset#3.DRILL.[] could not be implemented; planner state:

Root: rel#301:Subset#3.DRILL.[]
Original rel:
AbstractConverter(subset=rel#301:Subset#3.DRILL.[], convention=[DRILL], sort=[[]]): rowcount = 1.7976931348623157E308, cumulative cost =

{inf}, id = 302
ProjectRel(subset=rel#300:Subset#3.NONE.PRESERVE, first_name=[$0]): rowcount = 1.7976931348623157E308, cumulative cost = {1.7976931348623157E308 rows, 1.7976931348623157E308 cpu, 0.0 io}, id = 299
SortRel(subset=rel#298:Subset#2.NONE.[1 Ascending], sort0=[$1], dir0=[Ascending]): rowcount = 1.7976931348623157E308, cumulative cost = {Infinity rows, 1.7976931348623157E308 cpu, 0.0 io}, id = 297
ProjectRel(subset=rel#296:Subset#1.NONE.[], first_name=[$1], number=[$0]): rowcount = 100.0, cumulative cost = {100.0 rows, 200.0 cpu, 0.0 io}, id = 295
EnumerableTableAccessRel(subset=rel#294:Subset#0.ENUMERABLE.[], table=[[hive, doctors]]): rowcount = 100.0, cumulative cost = {100.0 rows, 101.0 cpu, 0.0 io}, id = 290

Sets:
Set#0, type: RecordType(INTEGER number, VARCHAR(1) first_name, VARCHAR(1) last_name)
rel#294:Subset#0.ENUMERABLE.[], best=rel#290, importance=0.6561
rel#290:EnumerableTableAccessRel.ENUMERABLE.[](table=[hive, doctors]), rowcount=100.0, cumulative cost={100.0 rows, 101.0 cpu, 0.0 io}
rel#318:AbstractConverter.ENUMERABLE.[](child=rel#317:Subset#0.DRILL.[],convention=ENUMERABLE,sort=[]), rowcount=100.0, cumulative cost={inf}

rel#317:Subset#0.DRILL.[], best=rel#322, importance=0.5904900000000001
rel#319:AbstractConverter.DRILL.[](child=rel#294:Subset#0.ENUMERABLE.[],convention=DRILL,sort=[]), rowcount=100.0, cumulative cost=

{inf}
rel#322:DrillScanRel.DRILL.[](table=[hive, doctors]), rowcount=100.0, cumulative cost={100.0 rows, 101.0 cpu, 0.0 io}
Set#1, type: RecordType(VARCHAR(1) first_name, INTEGER number)
rel#296:Subset#1.NONE.[], best=null, importance=0.7290000000000001
rel#295:ProjectRel.NONE.[](child=rel#294:Subset#0.ENUMERABLE.[],first_name=$1,number=$0), rowcount=100.0, cumulative cost={inf}

rel#310:Subset#1.DRILL.[], best=rel#320, importance=0.6561
rel#311:AbstractConverter.DRILL.[](child=rel#296:Subset#1.NONE.[],convention=DRILL,sort=[]), rowcount=1.7976931348623157E308, cumulative cost=

{inf}
rel#320:DrillProjectRel.DRILL.[](child=rel#317:Subset#0.DRILL.[],first_name=$1,number=$0), rowcount=100.0, cumulative cost={110.0 rows, 121.0 cpu, 0.0 io}
Set#2, type: RecordType(VARCHAR(1) first_name, INTEGER number)
rel#298:Subset#2.NONE.[1 Ascending], best=null, importance=0.81
rel#297:SortRel.NONE.[1 Ascending](child=rel#296:Subset#1.NONE.[],sort0=$1,dir0=Ascending), rowcount=1.7976931348623157E308, cumulative cost={inf}

rel#303:Subset#2.DRILL.PRESERVE, best=null, importance=0.81
rel#304:AbstractConverter.DRILL.PRESERVE(child=rel#298:Subset#2.NONE.[1 Ascending],convention=DRILL,sort=PRESERVE), rowcount=1.7976931348623157E308, cumulative cost=

{inf}
rel#314:AbstractConverter.DRILL.PRESERVE(child=rel#313:Subset#2.DRILL.[1 Ascending],convention=DRILL,sort=PRESERVE), rowcount=100.0, cumulative cost={inf}

rel#313:Subset#2.DRILL.[1 Ascending], best=rel#312, importance=0.7290000000000001
rel#315:AbstractConverter.DRILL.[1 Ascending](child=rel#298:Subset#2.NONE.[1 Ascending],convention=DRILL,sort=[1 Ascending]), rowcount=1.7976931348623157E308, cumulative cost=

{inf}
rel#316:AbstractConverter.DRILL.[1 Ascending](child=rel#303:Subset#2.DRILL.PRESERVE,convention=DRILL,sort=[1 Ascending]), rowcount=1.7976931348623157E308, cumulative cost={inf}

rel#312:DrillSortRel.DRILL.[1 Ascending](child=rel#310:Subset#1.DRILL.[],sort0=$1,dir0=Ascending), rowcount=100.0, cumulative cost=

{3794.1361487904733 rows, 221.0 cpu, 0.0 io}

Set#3, type: RecordType(VARCHAR(1) first_name)
rel#300:Subset#3.NONE.PRESERVE, best=null, importance=0.9
rel#299:ProjectRel.NONE.PRESERVE(child=rel#298:Subset#2.NONE.[1 Ascending],first_name=$0), rowcount=1.7976931348623157E308, cumulative cost=

{inf}
rel#301:Subset#3.DRILL.[], best=null, importance=1.0
rel#302:AbstractConverter.DRILL.[](child=rel#300:Subset#3.NONE.PRESERVE,convention=DRILL,sort=[]), rowcount=1.7976931348623157E308, cumulative cost={inf}

rel#307:AbstractConverter.DRILL.[](child=rel#306:Subset#3.DRILL.PRESERVE,convention=DRILL,sort=[]), rowcount=1.7976931348623157E308, cumulative cost=

{inf}
rel#308:AbstractConverter.DRILL.PRESERVE(child=rel#300:Subset#3.NONE.PRESERVE,convention=DRILL,sort=PRESERVE), rowcount=1.7976931348623157E308, cumulative cost={inf}

rel#309:AbstractConverter.DRILL.PRESERVE(child=rel#301:Subset#3.DRILL.[],convention=DRILL,sort=PRESERVE), rowcount=1.7976931348623157E308, cumulative cost=

{inf}
rel#305:DrillProjectRel.DRILL.PRESERVE(child=rel#303:Subset#2.DRILL.PRESERVE,first_name=$0), rowcount=1.7976931348623157E308, cumulative cost={inf}

rel#306:Subset#3.DRILL.PRESERVE, best=null, importance=0.9
rel#308:AbstractConverter.DRILL.PRESERVE(child=rel#300:Subset#3.NONE.PRESERVE,convention=DRILL,sort=PRESERVE), rowcount=1.7976931348623157E308, cumulative cost=

{inf}
rel#309:AbstractConverter.DRILL.PRESERVE(child=rel#301:Subset#3.DRILL.[],convention=DRILL,sort=PRESERVE), rowcount=1.7976931348623157E308, cumulative cost={inf}

rel#305:DrillProjectRel.DRILL.PRESERVE(child=rel#303:Subset#2.DRILL.PRESERVE,first_name=$0), rowcount=1.7976931348623157E308, cumulative cost=

{inf}

org.eigenbase.relopt.volcano.RelSubset$CheapestPlanReplacer.visit(RelSubset.java:442) ~[optiq-core-0.4.18.jar:na]
org.eigenbase.relopt.volcano.RelSubset.buildCheapestPlan(RelSubset.java:284) ~[optiq-core-0.4.18.jar:na]
org.eigenbase.relopt.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:628) ~[optiq-core-0.4.18.jar:na]
net.hydromatic.optiq.prepare.PlannerImpl.transform(PlannerImpl.java:200) ~[optiq-core-0.4.18.jar:na]
org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:75) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:350) [drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:175) [drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]