Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6882

Handle the cases where RowKeyJoin's left pipeline being called multiple times.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.15.0
    • Fix Version/s: 1.15.0
    • Component/s: None
    • Labels:

      Description

      RowKeyJoin operator's leftStream pipeline uses IterOutcome.NONE state to repeat the pipeline multiple times. This should be avoided as IterOutcome.NONE will assertion checks in validator. We ran into this issue when trying to fix DRILL-6878.

      Sample unit test failure from DRILL-6878

      select t1.id.ssn as ssn from hbase.`index_test_primary` t1, hbase.`index_test_primary` t2 where t1._id = t2.rowid and cast(t2.activity.irs.firstlogin as timestamp) = to_timestamp('2013-02-04 22:34:38.0', 'YYYY-MM-dd HH:mm:ss.S')

      at org.apache.drill.test.DrillTestWrapper.compareMergedOnHeapVectors(DrillTestWrapper.java:630) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at org.apache.drill.test.DrillTestWrapper.compareOrderedResults(DrillTestWrapper.java:584) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at org.apache.drill.test.DrillTestWrapper.run(DrillTestWrapper.java:157) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at org.apache.drill.test.TestBuilder.go(TestBuilder.java:139) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at com.mapr.drill.maprdb.tests.index.IndexPlanTest.testRowkeyJoinPushdown_7(IndexPlanTest.java:1828) ~[test-classes/:na]

      at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_141]

      Caused by: org.apache.drill.exec.rpc.RpcException: org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: IllegalStateException: next() on #851, ScanBatch called again after it returned NONE.  Caller should not have called next() again.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gparai Gautam Parai
                Reporter:
                gparai Gautam Parai
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: