[DRILL-4981] TPC-DS Query 75 & simplified variant fails on MapR-DB JSON Tables

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Component/s: Storage - MapRDB
• Assignee: Smidth Panchamia
• Reporter: Abhishek Girish
• Created: 28/Oct/16 22:16
• Updated: 14/May/17 00:45
• Resolved: 21/Nov/16 18:58

Description

TPC-DS Query 75 fails on MapR-DB JSON Tables, but succeeds on Text, Parquet & JSON File formats.

Simplified Query:

select cs_item_sk from catalog_sales UNION select ss_item_sk from store_sales limit 1;

Error

Error: SYSTEM ERROR: NullPointerException
[Error Id: 50e38332-896d-4836-9f5b-0c2c4c0bf553 on atsqa6c85.qa.lab:31010]
  (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception during fragment initialization: null
    org.apache.drill.exec.work.foreman.Foreman.run():281
    java.util.concurrent.ThreadPoolExecutor.runWorker():1145
    java.util.concurrent.ThreadPoolExecutor$Worker.run():615
    java.lang.Thread.run():744
  Caused By (java.lang.NullPointerException) null
    org.apache.drill.exec.store.mapr.db.MapRDBGroupScan.applyAssignments():205
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitGroupScan():116
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitGroupScan():103
    org.apache.drill.exec.physical.base.AbstractGroupScan.accept():63
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitChildren():138
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():134
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():103
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject():77
    org.apache.drill.exec.physical.config.Project.accept():51
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitChildren():138
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():134
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():103
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitUnion():57
    org.apache.drill.exec.physical.config.UnionAll.accept():44
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitChildren():138
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():134
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():103
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashAggregate():102
    org.apache.drill.exec.physical.config.HashAggregate.accept():67
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitChildren():138
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():134
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():103
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject():77
    org.apache.drill.exec.physical.config.Project.accept():51
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitChildren():138
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitOp():134
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitExchange():108
    org.apache.drill.exec.planner.fragment.Wrapper$AssignEndpointsToScanAndStore.visitExchange():103
    org.apache.drill.exec.physical.base.AbstractExchange.accept():123
    org.apache.drill.exec.planner.fragment.Wrapper.assignEndpoints():148
    org.apache.drill.exec.planner.fragment.SoftAffinityFragmentParallelizer.parallelizeFragment():86
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.parallelizeFragment():251
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.parallelizeFragment():243
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.parallelizeFragment():243
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.parallelizeFragment():243
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.getFragmentsHelper():167
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.getFragments():126
    org.apache.drill.exec.work.foreman.Foreman.getQueryWorkUnit():596
    org.apache.drill.exec.work.foreman.Foreman.runPhysicalPlan():426
    org.apache.drill.exec.work.foreman.Foreman.runSQL():1010
    org.apache.drill.exec.work.foreman.Foreman.run():264
    java.util.concurrent.ThreadPoolExecutor.runWorker():1145
    java.util.concurrent.ThreadPoolExecutor$Worker.run():615
    java.lang.Thread.run():744 (state=,code=0)

TPC-DS Query 75:
https://github.com/mapr/drill-test-framework/blob/master/framework/resources/Advanced/tpcds/tpcds_sf1/original/maprdb/json/query75.sql