[DRILL-4949] Need better handling of empty parquet files

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.17.0
• Component/s: Storage - Parquet
• Assignee: Unassigned
• Reporter: Krystal
• Created: 17/Oct/16 17:44
• Updated: 04/Oct/19 12:37
• Resolved: 04/Oct/19 12:37

Description

I have an empty parquet file created from hive. When I tried to query against this table I got "IllegalArgumentException".

select * from `test_dir/voter_empty`;
Error: SYSTEM ERROR: IllegalArgumentException: MinorFragmentId 0 has no read entries assigned

  (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception during fragment initialization: MinorFragmentId 0 has no read entries assigned
    org.apache.drill.exec.work.foreman.Foreman.run():281
    java.util.concurrent.ThreadPoolExecutor.runWorker():1145
    java.util.concurrent.ThreadPoolExecutor$Worker.run():615
    java.lang.Thread.run():745
  Caused By (java.lang.IllegalArgumentException) MinorFragmentId 0 has no read entries assigned
    com.google.common.base.Preconditions.checkArgument():122
    org.apache.drill.exec.store.parquet.ParquetGroupScan.getSpecificScan():824
    org.apache.drill.exec.store.parquet.ParquetGroupScan.getSpecificScan():101
    org.apache.drill.exec.planner.fragment.Materializer.visitGroupScan():68
    org.apache.drill.exec.planner.fragment.Materializer.visitGroupScan():35
    org.apache.drill.exec.physical.base.AbstractGroupScan.accept():63
    org.apache.drill.exec.planner.fragment.Materializer.visitOp():102
    org.apache.drill.exec.planner.fragment.Materializer.visitOp():35
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject():79
    org.apache.drill.exec.physical.config.Project.accept():51
    org.apache.drill.exec.planner.fragment.Materializer.visitStore():82
    org.apache.drill.exec.planner.fragment.Materializer.visitStore():35
    org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen():202
    org.apache.drill.exec.physical.config.Screen.accept():98
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.generateWorkUnit():283
    org.apache.drill.exec.planner.fragment.SimpleParallelizer.getFragments():127
    org.apache.drill.exec.work.foreman.Foreman.getQueryWorkUnit():596
    org.apache.drill.exec.work.foreman.Foreman.runPhysicalPlan():426
    org.apache.drill.exec.work.foreman.Foreman.runSQL():1010
    org.apache.drill.exec.work.foreman.Foreman.run():264
    java.util.concurrent.ThreadPoolExecutor.runWorker():1145
    java.util.concurrent.ThreadPoolExecutor$Worker.run():615
    java.lang.Thread.run():745 (state=,code=0)

Either drill should block the query and display a user friendly error message or allow the query to run and return empty result.