[DRILL-6487] Negative row count when selecting from a json file with an OFFSET clause

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13.0
• Fix Version/s: 1.14.0
• Component/s: Query Planning & Optimization
• Labels: ready-to-commit
• Assignee: Gautam Parai
• Reporter: Boaz Ben-Zvi
• Reviewer: Aman Sinha
• Created: 11/Jun/18 22:07
• Updated: 16/Jun/18 05:47
• Resolved: 16/Jun/18 05:47

Description

This simple query fails:

select * from dfs.`/data/foo.json` offset 1 row;

where foo.json is

{"key": "aa", "sales": 11}
{"key": "bb", "sales": 22}

The error returned is:

0: jdbc:drill:zk=local> select * from dfs.`/data/foo.json` offset 1 row;
Error: SYSTEM ERROR: AssertionError


[Error Id: 960d66a9-b480-4a7e-9a25-beb4928e8139 on 10.254.130.25:31020]

  (org.apache.drill.exec.work.foreman.ForemanException) Unexpected exception during fragment initialization: null
    org.apache.drill.exec.work.foreman.Foreman.run():282
    java.util.concurrent.ThreadPoolExecutor.runWorker():1142
    java.util.concurrent.ThreadPoolExecutor$Worker.run():617
    java.lang.Thread.run():745
  Caused By (java.lang.AssertionError) null
    org.apache.calcite.rel.metadata.RelMetadataQuery.isNonNegative():900
    org.apache.calcite.rel.metadata.RelMetadataQuery.validateResult():919
    org.apache.calcite.rel.metadata.RelMetadataQuery.getRowCount():236
    org.apache.calcite.rel.SingleRel.estimateRowCount():68
    org.apache.drill.exec.planner.physical.visitor.ExcessiveExchangeIdentifier$MajorFragmentStat.add():103
    org.apache.drill.exec.planner.physical.visitor.ExcessiveExchangeIdentifier.visitPrel():76
    org.apache.drill.exec.planner.physical.visitor.ExcessiveExchangeIdentifier.visitPrel():32
    org.apache.drill.exec.planner.physical.visitor.BasePrelVisitor.visitProject():50
    org.apache.drill.exec.planner.physical.ProjectPrel.accept():98
    org.apache.drill.exec.planner.physical.visitor.ExcessiveExchangeIdentifier.visitScreen():63
    org.apache.drill.exec.planner.physical.visitor.ExcessiveExchangeIdentifier.visitScreen():32
    org.apache.drill.exec.planner.physical.ScreenPrel.accept():65
    org.apache.drill.exec.planner.physical.visitor.ExcessiveExchangeIdentifier.removeExcessiveEchanges():41
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToPrel():557
    org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan():179
    org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():145
    org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():83
    org.apache.drill.exec.work.foreman.Foreman.runSQL():567
    org.apache.drill.exec.work.foreman.Foreman.run():264
    java.util.concurrent.ThreadPoolExecutor.runWorker():1142
    java.util.concurrent.ThreadPoolExecutor$Worker.run():617
    java.lang.Thread.run():745 (state=,code=0)

Issue Links

• links to: GitHub Pull Request #1322