[DRILL-4044] NPE in partition pruning test on (JDK8 + Drill 1.3)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.3.0
• Fix Version/s: 1.5.0
• Component/s: Execution - Flow

Environment

4 node cluster CentOS

• Assignee: Abdel Hakim Deneche
• Reporter: Khurram Faraaz
• Created: 06/Nov/15 01:15
• Updated: 04/Jan/16 06:31
• Resolved: 07/Dec/15 22:00

Description

NPE reported in drillbit.log for parquet partition pruning test with Drill 1.3 and JDK 8

Failing query is from test file Functional/partition_pruning/hive/parquet/dynamic_int_partition/data/parquetSelectPartOrMultipleWithDirIN.q

select l_orderkey, l_partkey, l_quantity, cast(l_shipdate as date) l_shipdate, l_shipinstruct, `year` from hive.dynamic_partitions.lineitem_parquet_partitioned_hive where (`year` IN (1993) and l_orderkey>29600) or (`year` IN (1994) and l_orderkey>29700);

From test output file - dynamicPartitionDirectoryHive-IntPartitionData_parquetSelectPartOrMultipleWithDirIN.output_Fri_Nov_06_00:44:16_UTC_2015

0       SYSTEM ERROR: NullPointerException

Fragment 0:0

[Error Id: c6f424ce-10b9-48e1-8783-b0dd281b6fc3 on centos-01.qa.lab:31010]

From the drillbit.log

2015-11-06 00:44:17,222 [29c4081f-628a-fda7-05c5-a70aa9aa148b:foreman] INFO  o.a.d.e.p.l.partition.PruneScanRule - Pruned 7 partitions down to 2
2015-11-06 00:44:17,256 [29c4081f-628a-fda7-05c5-a70aa9aa148b:foreman] INFO  o.a.d.e.p.l.partition.PruneScanRule - No partitions were eligible for pruning
2015-11-06 00:44:17,323 [29c4081f-628a-fda7-05c5-a70aa9aa148b:frag:0:0] INFO  o.a.d.e.w.fragment.FragmentExecutor - 29c4081f-628a-fda7-05c5-a70aa9aa148b:0:0: State change requested AWAITING_ALLOCATION --> FAILED
2015-11-06 00:44:17,323 [29c4081f-628a-fda7-05c5-a70aa9aa148b:frag:0:0] INFO  o.a.d.e.w.fragment.FragmentExecutor - 29c4081f-628a-fda7-05c5-a70aa9aa148b:0:0: State change requested FAILED --> FINISHED
2015-11-06 00:44:17,324 [29c4081f-628a-fda7-05c5-a70aa9aa148b:frag:0:0] ERROR o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: NullPointerException

Fragment 0:0

[Error Id: c6f424ce-10b9-48e1-8783-b0dd281b6fc3 on centos-01.qa.lab:31010]
org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: NullPointerException

Fragment 0:0

[Error Id: c6f424ce-10b9-48e1-8783-b0dd281b6fc3 on centos-01.qa.lab:31010]
        at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:534) ~[drill-common-1.3.0-SNAPSHOT.jar:1.3.0-SNAPSHOT]
        at org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:323) [drill-java-exec-1.3.0-SNAPSHOT.jar:1.3.0-SNAPSHOT]
        at org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:178) [drill-java-exec-1.3.0-SNAPSHOT.jar:1.3.0-SNAPSHOT]
        at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:292) [drill-java-exec-1.3.0-SNAPSHOT.jar:1.3.0-SNAPSHOT]
        at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) [drill-common-1.3.0-SNAPSHOT.jar:1.3.0-SNAPSHOT]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_65]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_65]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_65]

Issue Links

• duplicates: DRILL-4035 NPE seen on Functional test run using JDK 8