[EAGLE-1008] java.lang.NullPointerException in JHFEventReaderBase.close

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v0.5.0
• Fix Version/s: v0.5.0
• Assignee: Qingwen Zhao
• Reporter: Qingwen Zhao
• Created: 18/Apr/17 06:54
• Updated: 09/May/17 21:34
• Resolved: 09/May/17 21:34

Description

2017-04-17 19:53:31 Thread-8-mrHistoryJobSpout org.apache.eagle.jpm.mr.history.parser.JHFMRVer2Parser [ERROR] Caught exception parsing history file after 99 events
java.io.IOException: java.lang.NullPointerException
        at org.apache.eagle.jpm.mr.history.parser.JHFEventReaderBase.close(JHFEventReaderBase.java:153) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.parser.JHFMRVer2Parser.parse(JHFMRVer2Parser.java:65) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.crawler.DefaultJHFInputStreamCallback.onInputStream(DefaultJHFInputStreamCallback.java:60) [stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.crawler.AbstractJobHistoryDAO.readFileContent(AbstractJobHistoryDAO.java:123) [stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.crawler.JHFCrawlerDriverImpl.crawl(JHFCrawlerDriverImpl.java:166) [stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.storm.JobHistorySpout.nextTuple(JobHistorySpout.java:166) [stormjar.jar:na]
        at backtype.storm.daemon.executor$fn__5629$fn__5644$fn__5673.invoke(executor.clj:585) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
        at backtype.storm.util$async_loop$fn__452.invoke(util.clj:465) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
        at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
Caused by: java.lang.NullPointerException: null
        at org.apache.eagle.jpm.util.jobcounter.JobCounters.getCounterValue(JobCounters.java:51) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.analyzer.mr.suggestion.MapReduceJobSuggestionContext.getMinimumIOSortMemory(MapReduceJobSuggestionContext.java:137) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.analyzer.mr.suggestion.MapReduceJobSuggestionContext.buildContext(MapReduceJobSuggestionContext.java:86) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.analyzer.mr.suggestion.MapReduceJobSuggestionContext.<init>(MapReduceJobSuggestionContext.java:64) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.analyzer.mr.suggestion.JobSuggestionEvaluator.evaluate(JobSuggestionEvaluator.java:76) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.analyzer.mr.suggestion.JobSuggestionEvaluator.evaluate(JobSuggestionEvaluator.java:38) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.analyzer.mr.MRJobPerformanceAnalyzer.analyze(MRJobPerformanceAnalyzer.java:64) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.parser.JobSuggestionListener.flush(JobSuggestionListener.java:93) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.parser.JobEntityCreationPublisher.flush(JobEntityCreationPublisher.java:40) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.parser.JHFEventReaderBase.flush(JHFEventReaderBase.java:159) ~[stormjar.jar:na]
        at org.apache.eagle.jpm.mr.history.parser.JHFEventReaderBase.close(JHFEventReaderBase.java:150) ~[stormjar.jar:na]
        ... 9 common frames omitted

Issue Links

• links to: GitHub Pull Request #919