[DRILL-4517] Reading emtpy Parquet file failes with java.lang.IllegalArgumentException

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.17.0
• Component/s: Server
• Labels: doc-impacting ready-to-commit
• Assignee: Arina Ielchiieva
• Reporter: Tobias
• Reviewer: Vova Vysotskyi
• Created: 17/Mar/16 07:39
• Updated: 12/Aug/19 17:32
• Resolved: 12/Aug/19 17:32

Description

When querying a Parquet file that has a schema but no rows the Drill Server will fail with the below
This looks similar to DRILL-3557

{{ParquetMetaData{FileMetaData{schema: message TRANSACTION_REPORT {
  required int64 MEMBER_ACCOUNT_ID;
  required int64 TIMESTAMP_IN_HOUR;
  optional int64 APPLICATION_ID;
}
, metadata: {}}}, blocks: []}

Caused by: java.lang.IllegalArgumentException: MinorFragmentId 0 has no read entries assigned
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:92) ~[guava-14.0.1.jar:na]
        at org.apache.drill.exec.store.parquet.ParquetGroupScan.getSpecificScan(ParquetGroupScan.java:707) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.store.parquet.ParquetGroupScan.getSpecificScan(ParquetGroupScan.java:105) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.Materializer.visitGroupScan(Materializer.java:68) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.Materializer.visitGroupScan(Materializer.java:35) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.physical.base.AbstractGroupScan.accept(AbstractGroupScan.java:60) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.Materializer.visitOp(Materializer.java:102) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.Materializer.visitOp(Materializer.java:35) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject(AbstractPhysicalVisitor.java:77) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.physical.config.Project.accept(Project.java:51) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.Materializer.visitStore(Materializer.java:82) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.Materializer.visitStore(Materializer.java:35) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:195) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.SimpleParallelizer.generateWorkUnit(SimpleParallelizer.java:355) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.planner.fragment.SimpleParallelizer.getFragments(SimpleParallelizer.java:134) ~[drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.work.foreman.Foreman.getQueryWorkUnit(Foreman.java:518) [drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.work.foreman.Foreman.runPhysicalPlan(Foreman.java:405) [drill-java-exec-1.5.0.jar:1.5.0]
        at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:926) [drill-java-exec-1.5.0.jar:1.5.0]

Issue Links

• incorporates: DRILL-6528 Planner setting the wrong number of records to read (Parquet Reader)
• is duplicated by: DRILL-5298 CTAS with 0 records from a SELECT query should create the table with metadata
• is related to: DRILL-6885 CTAS for empty output doesn't create parquet file or folder
• is related to: DRILL-2223 Empty parquet file created with Limit 0 query errors out when querying
• supercedes: DRILL-1834 Misleading error message when querying an empty Parquet file
• links to: GitHub Pull Request #1839