Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7067

Querying parquet file with null value field error

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Blocker
    • Resolution: Unresolved
    • Affects Version/s: 1.15.0
    • Fix Version/s: Future
    • Component/s: Storage - Parquet
    • Labels:
      None
    • Environment:

      Ubuntu 18.04.1 LTS 

      Apache Drill 1.15.0 

      Description

      When we try to join two parquet tables and one of them has null values on any field, the query doesn't run. It fails showing the following error: 

      Error: SYSTEM ERROR: IllegalStateException: Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])]

      Fragment 2:0

      Please, refer to logs for more information.

      Error Id: 48f63255-c771-4809-8252-ef7a78fda31b on ################

      (java.lang.IllegalStateException) Failure while reading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarDecimalVector, field= [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$bits$` (UINT1:REQUIRED)], [`id_hubbles` (VARDECIMAL(38, 4):OPTIONAL), children=([`$offsets$` (UINT4:REQUIRED)])])]
      org.apache.drill.exec.record.VectorContainer.getValueAccessorById():324
      org.apache.drill.exec.record.RecordBatchLoader.getValueAccessorById():251
      org.apache.drill.exec.physical.impl.unorderedreceiver.UnorderedReceiverBatch.getValueAccessorById():142
      org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.doSetup():114
      org.apache.drill.exec.test.generated.PartitionerGen1732$OutgoingRecordBatch.initializeBatch():399
      org.apache.drill.exec.test.generated.PartitionerGen1732.flushOutgoingBatches():185
      org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$FlushBatchesHandlingClass.execute():285
      org.apache.drill.exec.physical.impl.partitionsender.PartitionerDecorator$PartitionerTask.run():340
      java.util.concurrent.ThreadPoolExecutor.runWorker():1149
      java.util.concurrent.ThreadPoolExecutor$Worker.run():624
      java.lang.Thread.run():748 (state=,code=0)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jcachola Jardhel Cachola
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: