[SQOOP-1148] NPE while commiting import job

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.0.0
• Fix Version/s: no-release
• Assignee: Raghav Kumar Gautam
• Reporter: Raghav Kumar Gautam
• Created: 22/Jul/13 20:45
• Updated: 26/Jul/13 18:55
• Resolved: 22/Jul/13 21:06

Description

Import job failed with NPE because it was not able to commit the job. This was on hadoop2, here is the relevant part of the job log:

2013-07-19 16:35:56,840 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1374270875354_0004Job Transitioned from RUNNING to COMMITTING
2013-07-19 16:35:56,841 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
2013-07-19 16:35:56,882 ERROR [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Could not commit job
java.lang.NullPointerException
	at java.lang.String.<init>(String.java:593)
	at org.apache.sqoop.job.mr.ConfigurationUtils.loadConfiguration(ConfigurationUtils.java:252)
	at org.apache.sqoop.job.mr.ConfigurationUtils.getConfigConnectorConnection(ConfigurationUtils.java:144)
	at org.apache.sqoop.job.mr.SqoopDestroyerExecutor.executeDestroyer(SqoopDestroyerExecutor.java:55)
	at org.apache.sqoop.job.mr.SqoopFileOutputFormat$DestroyerFileOutputCommitter.commitJob(SqoopFileOutputFormat.java:88)
	at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:249)
	at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:212)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:680)
2013-07-19 16:35:56,886 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1374270875354_0004Job Transitioned from COMMITTING to FAIL_ABORT
2013-07-19 16:35:56,887 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT
2013-07-19 16:35:56,888 WARN [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Could not abort job
java.lang.NullPointerException
	at java.lang.String.<init>(String.java:593)
	at org.apache.sqoop.job.mr.ConfigurationUtils.loadConfiguration(ConfigurationUtils.java:252)
	at org.apache.sqoop.job.mr.ConfigurationUtils.getConfigConnectorConnection(ConfigurationUtils.java:144)
	at org.apache.sqoop.job.mr.SqoopDestroyerExecutor.executeDestroyer(SqoopDestroyerExecutor.java:55)
	at org.apache.sqoop.job.mr.SqoopFileOutputFormat$DestroyerFileOutputCommitter.abortJob(SqoopFileOutputFormat.java:96)
	at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobAbort(CommitterEventHandler.java:273)
	at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:215)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:680)
2013-07-19 16:35:56,891 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1374270875354_0004Job Transitioned from FAIL_ABORT to FAILED
2013-07-19 16:35:56,892 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Job end notification started for jobID : job_1374270875354_0004
2013-07-19 16:35:56,894 INFO [Thread-68] org.mortbay.log: Job end notification attempts left 0