Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6733

Unit tests from KafkaFilterPushdownTest are failing in some environments.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.14.0
    • 1.15.0
    • None

    Description

      Steps:

      1. Build the Drill project without skipping the unit tests:
        mvn clean install
        

        Alternatively, if the project was already built, run tests for Kafka:

        mvn test -pl contrib/storage-kafka
        

      Expected results:
      All tests are passed.

      Actual results:
      Tests from KafkaFilterPushdownTest are failing:

      ------------------------------------------------------- 
      T E S T S 
      ------------------------------------------------------- 
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: -1,283,514.348 sec - in org.apache.drill.exec.store.kafka.MessageIteratorTest 
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: -1,283,513.783 sec - in org.apache.drill.exec.store.kafka.KafkaQueriesTest 
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: -1,283,512.35 sec - in org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest 
      Running org.apache.drill.exec.store.kafka.decoders.MessageReaderFactoryTest 
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.051 sec - in org.apache.drill.exec.store.kafka.decoders.MessageReaderFactoryTest 
      Running org.apache.drill.exec.store.kafka.KafkaQueriesTest 
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 152.2 sec - in org.apache.drill.exec.store.kafka.KafkaQueriesTest 
      Running org.apache.drill.exec.store.kafka.MessageIteratorTest 
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.036 sec - in org.apache.drill.exec.store.kafka.MessageIteratorTest 
      Running org.apache.drill.exec.store.kafka.decoders.MessageReaderFactoryTest 
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.611 sec - in org.apache.drill.exec.store.kafka.decoders.MessageReaderFactoryTest 
      Running org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest 
      13:09:29.511 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 213 B(139.3 KiB), h: 20.0 MiB(719.0 MiB), nh: 794.5 KiB(120.1 MiB)): testPushdownWithOr(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<26> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithOr(KafkaFilterPushdownTest.java:259) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:09:33.307 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 377 B(139.7 KiB), h: 18.5 MiB(743.2 MiB), nh: 699.5 KiB(120.9 MiB)): testPushdownWithAndOrCombo2(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<4> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithAndOrCombo2(KafkaFilterPushdownTest.java:316) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:09:44.424 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 0 B(139.7 KiB), h: 11.7 MiB(774.6 MiB), nh: 537.1 KiB(122.3 MiB)): testPushdownOnTimestamp(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<20> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOnTimestamp(KafkaFilterPushdownTest.java:92) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:09:48.162 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 0 B(139.7 KiB), h: 13.3 MiB(787.9 MiB), nh: 379.9 KiB(122.7 MiB)): testPushdownOnOffset(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<5> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOnOffset(KafkaFilterPushdownTest.java:60) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:09:52.392 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 137 B(139.8 KiB), h: 13.0 MiB(800.9 MiB), nh: 467.9 KiB(123.2 MiB)): testPushdownWithOr1(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<10> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithOr1(KafkaFilterPushdownTest.java:277) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:10:03.534 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 0 B(140.0 KiB), h: 11.7 MiB(830.4 MiB), nh: 301.0 KiB(124.2 MiB)): testPushdownUnorderedTimestamp(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<5> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownUnorderedTimestamp(KafkaFilterPushdownTest.java:109) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:10:07.359 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: -1.0 KiB(139.0 KiB), h: -384.1 MiB(446.3 MiB), nh: 329.7 KiB(124.6 MiB)): testPushdownOffsetOneRecordReturnedWithBoundaryConditions(org.apache.drill.exec.store.kafk
      a.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<5> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOffsetOneRecordReturnedWithBoundaryConditions(KafkaFilterPushdownTest.java:227) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:10:11.134 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 3 B(139.0 KiB), h: 17.1 MiB(463.4 MiB), nh: 495.3 KiB(125.1 MiB)): testPushdownWithAndOrCombo(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<8> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithAndOrCombo(KafkaFilterPushdownTest.java:296) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      13:10:59.388 [main] ERROR org.apache.drill.TestReporter - Test Failed (d: 0 B(139.0 KiB), h: 7.5 MiB(578.8 MiB), nh: 304.2 KiB(128.2 MiB)): testPushdownOnPartition(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest) 
      java.lang.AssertionError: expected:<10> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) ~[test-classes/:na] 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOnPartition(KafkaFilterPushdownTest.java:76) ~[test-classes/:na] 
             at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_181] 
      Tests run: 15, Failures: 9, Errors: 0, Skipped: 0, Time elapsed: 2,582.537 sec <<< FAILURE! - in org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest 
      testPushdownWithOr(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.753 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<26> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithOr(KafkaFilterPushdownTest.java:259) 
      
      testPushdownWithAndOrCombo2(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.79 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<4> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithAndOrCombo2(KafkaFilterPushdownTest.java:316) 
      
      testPushdownOnTimestamp(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.716 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<20> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOnTimestamp(KafkaFilterPushdownTest.java:92) 
      
      testPushdownOnOffset(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.741 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<5> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOnOffset(KafkaFilterPushdownTest.java:60) 
      
      testPushdownWithOr1(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 4.227 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<10> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithOr1(KafkaFilterPushdownTest.java:277) 
      
      testPushdownUnorderedTimestamp(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.721 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<5> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownUnorderedTimestamp(KafkaFilterPushdownTest.java:109) 
      
      testPushdownOffsetOneRecordReturnedWithBoundaryConditions(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.831 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<5> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOffsetOneRecordReturnedWithBoundaryConditions(KafkaFilterPushdownTest.java:227) 
      
      testPushdownWithAndOrCombo(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.769 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<8> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownWithAndOrCombo(KafkaFilterPushdownTest.java:296) 
      
      testPushdownOnPartition(org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest)  Time elapsed: 3.96 sec  <<< FAILURE! 
      java.lang.AssertionError: expected:<10> but was:<0> 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.logResultAndVerifyRowCount(KafkaTestBase.java:76) 
             at org.apache.drill.exec.store.kafka.KafkaTestBase.runKafkaSQLVerifyCount(KafkaTestBase.java:69) 
             at org.apache.drill.exec.store.kafka.KafkaFilterPushdownTest.testPushdownOnPartition(KafkaFilterPushdownTest.java:76) 
      
      
      Results : 
      
      Failed tests:  
       KafkaFilterPushdownTest.testPushdownWithOr:259->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<26> but was:<0> 
       KafkaFilterPushdownTest.testPushdownWithAndOrCombo2:316->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<4> but was:<0> 
       KafkaFilterPushdownTest.testPushdownOnTimestamp:92->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<20> but was:<0> 
       KafkaFilterPushdownTest.testPushdownOnOffset:60->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<5> but was:<0> 
       KafkaFilterPushdownTest.testPushdownWithOr1:277->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<10> but was:<0> 
       KafkaFilterPushdownTest.testPushdownUnorderedTimestamp:109->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<5> but was:<0> 
       KafkaFilterPushdownTest.testPushdownOffsetOneRecordReturnedWithBoundaryConditions:227->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<5> but was:<0> 
       KafkaFilterPushdownTest.testPushdownWithAndOrCombo:296->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<8> but was:<0> 
       KafkaFilterPushdownTest.testPushdownOnPartition:76->KafkaTestBase.runKafkaSQLVerifyCount:69->KafkaTestBase.logResultAndVerifyRowCount:76 expected:<10> but was:<0> 
      
      Tests run: 35, Failures: 9, Errors: 0, Skipped: 3 
      
      [INFO] ------------------------------------------------------------------------ 
      [INFO] BUILD FAILURE 
      [INFO] ------------------------------------------------------------------------ 
      [INFO] Total time: 46:02 min 
      [INFO] Finished at: 2018-09-07T13:52:05+03:00 
      [INFO] ------------------------------------------------------------------------
      
      

       
      Workaround: Increase the fork count:

      mvn test -pl contrib/storage-kafka -DforkCount=3
      

      Attachments

        Issue Links

          Activity

            People

              angozhiy Anton Gozhiy
              angozhiy Anton Gozhiy
              Vitalii Diravka Vitalii Diravka
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: