Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-8012

Flaky tests TestExtendedTypes and TestNestedDateTimeTimestamp

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.19.0
    • None
    • None
    • None

    Description

       

      Sometimes these tests fail: TestNestedDateTimeTimestamp.testNestedDateTimeCTASExtendedJson:155
TestExtendedTypes.checkReadWriteExtended:58 
      [ERROR]   TestExtendedTypes.checkReadWriteExtended:58 expected:<...date" : "2009-02-23T[08:00:00.000Z"
  },
  "time" : {
    "$time" : "19:20:30.450Z"
  },
  "interval" : {
    "$interval" : "PT26.400S"
  },
  "integer" : {
    "$numberLong" : 4
  },
  "inner" : {
    "bin" : {
      "$binary" : "ZHJpbGw="
    },
    "drill_date" : {
      "$dateDay" : "1997-07-16"
    },
    "drill_timestamp" : {
      "$date" : "2009-02-23T08]:00:00.000Z"
    },
...> but was:<...date" : "2009-02-23T[10:00:00.000Z"
  },
  "time" : {
    "$time" : "19:20:30.450Z"
  },
  "interval" : {
    "$interval" : "PT26.400S"
  },
  "integer" : {
    "$numberLong" : 4
  },
  "inner" : {
    "bin" : {
      "$binary" : "ZHJpbGw="
    },
    "drill_date" : {
      "$dateDay" : "1997-07-16"
    },
    "drill_timestamp" : {
      "$date" : "2009-02-23T10]:00:00.000Z"
    },
...>
[ERROR] Errors: 
[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 7ea92921-6d93-4d57-8e0f-d35650e16b42 on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/all_nulls.parquet`
[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 5fb379d5-ebdc-4f10-a173-79427ec8b215 on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: be9f80e5-e7b0-4974-9ae8-c387cf8fb80c on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 04c9a620-4309-44a5-85d0-ddb092070fbd on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/first_page_all_nulls.parquet`
[ERROR]   org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: nullFragment: 0:0Please, refer to logs for more information.[Error Id: 376ca206-99e1-401f-af65-cf1af0fb4681 on drill:31028]  (java.lang.NullPointerException) null
    org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234
    org.apache.drill.exec.physical.impl.ScanBatch.internalNext():234
    org.apache.drill.exec.physical.impl.ScanBatch.next():298
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():111
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():59
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():85
    org.apache.drill.exec.record.AbstractRecordBatch.next():170
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():237
    org.apache.drill.exec.physical.impl.BaseRootExec.next():103
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():81
    org.apache.drill.exec.physical.impl.BaseRootExec.next():93
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():323
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():310
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1762
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():310
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748For query: select c_varchar, c_integer, c_bigint, c_float, c_double, c_date, c_time, c_timestamp, c_boolean from cp.`parquet/last_page_one_null.parquet`
[ERROR]   TestNestedDateTimeTimestamp.testNestedDateTimeCTASExtendedJson:155 »  at posit...
[INFO] 
[ERROR] Tests run: 5982, Failures: 2, Errors: 6, Skipped: 143

      Looks like the issue is in:

      (java.lang.NullPointerException) null  org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.next():234

       

      Attachments

        Issue Links

          Discovered while testing

          Sub-task - The sub-task of the issue DRILL-7973 Fix GitHub CI intermittent failures

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              vitalii Vitalii Diravka
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: