[CHUKWA-465] Misconfiguration leads to NullPointerException in PostProcessorManager

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Component/s: Data Processors

Environment

OS:

Fedora 12
Linux skinner.mustardgrain.com 2.6.32.9-70.fc12.x86_64 #1 SMP Wed Mar 3 04:40:41 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux

Java:

java version "1.6.0_18"
Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
Java HotSpot(TM) 64-Bit Server VM (build 16.0-b13, mixed mode)

• Assignee: Ahmed Fathalla
• Reporter: Kirk True
• Created: 17/Mar/10 00:36
• Updated: 09/Dec/11 20:21
• Resolved: 15/Apr/10 16:43

Description

I didn't know to copy chukwa-demux-conf.xml.template to chukwa-demux-conf.xml and got this error in postprocess.log:

----------------------------------------------

2010-03-16 16:46:18,150 INFO main PostProcessorManager - PostProcess Start, directory:/chukwa/postProcess/demuxOutputDir_1268783176828
2010-03-16 16:46:18,151 ERROR main PostProcessorManager - java.lang.NullPointerException
at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.processDemuxPigOutput(PostProcessorManager.java:173)
at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.start(PostProcessorManager.java:145)
at org.apache.hadoop.chukwa.extraction.demux.PostProcessorManager.main(PostProcessorManager.java:80)

2010-03-16 16:46:18,151 WARN main PostProcessorManager - Error in processDemuxOutput for :/chukwa/postProcess/demuxOutputDir_1268783176828
2010-03-16 16:46:18,175 WARN main PostProcessorManager - Error in postProcess :/chukwa/postProcess/demuxOutputDir_1268783176828 has been moved to:/chukwa/postProcessInError//demuxOutputDir_1268783176828_1268783178154

----------------------------------------------

The problem is here:

String[] classes = conf.get(POST_DEMUX_DATA_LOADER).split(",");

In my case (again, due to bad configuration) that configuration file is missing and so we end up trying to split through a null reference.

Note: I got this code from trunk, revision 924074.