Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6882

Handle the cases where RowKeyJoin's left pipeline being called multiple times.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 1.15.0
    • 1.15.0
    • None

    Description

      RowKeyJoin operator's leftStream pipeline uses IterOutcome.NONE state to repeat the pipeline multiple times. This should be avoided as IterOutcome.NONE will assertion checks in validator. We ran into this issue when trying to fix DRILL-6878.

      Sample unit test failure from DRILL-6878

      select t1.id.ssn as ssn from hbase.`index_test_primary` t1, hbase.`index_test_primary` t2 where t1._id = t2.rowid and cast(t2.activity.irs.firstlogin as timestamp) = to_timestamp('2013-02-04 22:34:38.0', 'YYYY-MM-dd HH:mm:ss.S')

      at org.apache.drill.test.DrillTestWrapper.compareMergedOnHeapVectors(DrillTestWrapper.java:630) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at org.apache.drill.test.DrillTestWrapper.compareOrderedResults(DrillTestWrapper.java:584) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at org.apache.drill.test.DrillTestWrapper.run(DrillTestWrapper.java:157) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at org.apache.drill.test.TestBuilder.go(TestBuilder.java:139) ~[drill-java-exec-1.15.0-SNAPSHOT-tests.jar:1.15.0-SNAPSHOT]

      at com.mapr.drill.maprdb.tests.index.IndexPlanTest.testRowkeyJoinPushdown_7(IndexPlanTest.java:1828) ~[test-classes/:na]

      at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_141]

      Caused by: org.apache.drill.exec.rpc.RpcException: org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: IllegalStateException: next() on #851, ScanBatch called again after it returned NONE.  Caller should not have called next() again.

       

      Attachments

        Issue Links

          Activity

            People

              gparai Gautam Parai
              gparai Gautam Parai
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: