[DRILL-7152] Histogram creation throws exception for all nulls column

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.16.0
• Component/s: Query Planning & Optimization
• Assignee: Aman Sinha
• Reporter: Aman Sinha
• Reviewer: Gautam Parai
• Created: 02/Apr/19 21:10
• Updated: 03/Apr/19 02:24
• Resolved: 03/Apr/19 02:24

Description

ANALYZE command fails when creating the histogram for a table with 1 column with all NULLs.

Analyze table `table_stats/parquet_col_nulls` compute statistics;

Error: SYSTEM ERROR: NullPointerException
  (org.apache.drill.common.exceptions.DrillRuntimeException) Failed to get TDigest output
    org.apache.drill.exec.test.generated.StreamingAggregatorGen32.outputRecordValues():1085
    org.apache.drill.exec.test.generated.StreamingAggregatorGen32.outputToBatchPrev():492
    org.apache.drill.exec.test.generated.StreamingAggregatorGen32.doWork():224
    org.apache.drill.exec.physical.impl.aggregate.StreamingAggBatch.innerNext():288
    org.apache.drill.exec.record.AbstractRecordBatch.next():186
    org.apache.drill.exec.record.AbstractRecordBatch.next():126
    org.apache.drill.exec.record.AbstractRecordBatch.next():116
    org.apache.drill.exec.physical.impl.statistics.StatisticsMergeBatch.innerNext():358
    org.apache.drill.exec.record.AbstractRecordBatch.next():186
    org.apache.drill.exec.record.AbstractRecordBatch.next():126
    org.apache.drill.exec.record.AbstractRecordBatch.next():116
    org.apache.drill.exec.physical.impl.unpivot.UnpivotMapsRecordBatch.innerNext():106
    org.apache.drill.exec.record.AbstractRecordBatch.next():186
    org.apache.drill.exec.record.AbstractRecordBatch.next():126
    org.apache.drill.exec.record.AbstractRecordBatch.next():116
    org.apache.drill.exec.physical.impl.StatisticsWriterRecordBatch.innerNext():96
    org.apache.drill.exec.record.AbstractRecordBatch.next():186
    org.apache.drill.exec.record.AbstractRecordBatch.next():126
    org.apache.drill.exec.record.AbstractRecordBatch.next():116
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():141
    org.apache.drill.exec.record.AbstractRecordBatch.next():186
    org.apache.drill.exec.physical.impl.BaseRootExec.next():104
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():83
    org.apache.drill.exec.physical.impl.BaseRootExec.next():94
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():296
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():283
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():422
    org.apache.hadoop.security.UserGroupInformation.doAs():1669
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():283
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1149
    java.util.concurrent.ThreadPoolExecutor$Worker.run():624
    java.lang.Thread.run():748

This table has 1 column with all NULL values:

apache drill (dfs.drilltestdir)> select * from `table_stats/parquet_col_nulls` limit 20;
+------+------+
| col1 | col2 |
+------+------+
| 0    | null |
| 1    | null |
| 2    | null |
| 3    | null |
| 4    | null |
| 5    | null |
| 6    | null |
| 7    | null |
| 8    | null |
| 9    | null |
| 10   | null |

Issue Links

• links to: GitHub Pull Request #1730