Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7152

Histogram creation throws exception for all nulls column

    XMLWordPrintableJSON

    Details

      Description

      ANALYZE command fails when creating the histogram for a table with 1 column with all NULLs.

      Analyze table `table_stats/parquet_col_nulls` compute statistics;

      Error: SYSTEM ERROR: NullPointerException
        (org.apache.drill.common.exceptions.DrillRuntimeException) Failed to get TDigest output
          org.apache.drill.exec.test.generated.StreamingAggregatorGen32.outputRecordValues():1085
          org.apache.drill.exec.test.generated.StreamingAggregatorGen32.outputToBatchPrev():492
          org.apache.drill.exec.test.generated.StreamingAggregatorGen32.doWork():224
          org.apache.drill.exec.physical.impl.aggregate.StreamingAggBatch.innerNext():288
          org.apache.drill.exec.record.AbstractRecordBatch.next():186
          org.apache.drill.exec.record.AbstractRecordBatch.next():126
          org.apache.drill.exec.record.AbstractRecordBatch.next():116
          org.apache.drill.exec.physical.impl.statistics.StatisticsMergeBatch.innerNext():358
          org.apache.drill.exec.record.AbstractRecordBatch.next():186
          org.apache.drill.exec.record.AbstractRecordBatch.next():126
          org.apache.drill.exec.record.AbstractRecordBatch.next():116
          org.apache.drill.exec.physical.impl.unpivot.UnpivotMapsRecordBatch.innerNext():106
          org.apache.drill.exec.record.AbstractRecordBatch.next():186
          org.apache.drill.exec.record.AbstractRecordBatch.next():126
          org.apache.drill.exec.record.AbstractRecordBatch.next():116
          org.apache.drill.exec.physical.impl.StatisticsWriterRecordBatch.innerNext():96
          org.apache.drill.exec.record.AbstractRecordBatch.next():186
          org.apache.drill.exec.record.AbstractRecordBatch.next():126
          org.apache.drill.exec.record.AbstractRecordBatch.next():116
          org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
          org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():141
          org.apache.drill.exec.record.AbstractRecordBatch.next():186
          org.apache.drill.exec.physical.impl.BaseRootExec.next():104
          org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():83
          org.apache.drill.exec.physical.impl.BaseRootExec.next():94
          org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():296
          org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():283
          java.security.AccessController.doPrivileged():-2
          javax.security.auth.Subject.doAs():422
          org.apache.hadoop.security.UserGroupInformation.doAs():1669
          org.apache.drill.exec.work.fragment.FragmentExecutor.run():283
          org.apache.drill.common.SelfCleaningRunnable.run():38
          java.util.concurrent.ThreadPoolExecutor.runWorker():1149
          java.util.concurrent.ThreadPoolExecutor$Worker.run():624
          java.lang.Thread.run():748
      

      This table has 1 column with all NULL values:

      apache drill (dfs.drilltestdir)> select * from `table_stats/parquet_col_nulls` limit 20;
      +------+------+
      | col1 | col2 |
      +------+------+
      | 0    | null |
      | 1    | null |
      | 2    | null |
      | 3    | null |
      | 4    | null |
      | 5    | null |
      | 6    | null |
      | 7    | null |
      | 8    | null |
      | 9    | null |
      | 10   | null |
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                amansinha100 Aman Sinha
                Reporter:
                amansinha100 Aman Sinha
                Reviewer:
                Gautam Parai
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: