[STORM-3344] blacklist scheduler causing nimbus restart

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Labels: pull-request-available
• Assignee: Aaron Gresch
• Reporter: Aaron Gresch
• Created: 22/Feb/19 16:59
• Updated: 16/Mar/19 03:26
• Resolved: 15/Mar/19 18:46

Description

2019-02-22 10:48:41.460 o.a.s.d.n.Nimbus timer [ERROR] Error while processing event
java.lang.RuntimeException: java.lang.UnsupportedOperationException
        at org.apache.storm.daemon.nimbus.Nimbus.lambda$launchServer$27(Nimbus.java:2872) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.StormTimer$1.run(StormTimer.java:110) ~[storm-client-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.StormTimer$StormTimerTask.run(StormTimer.java:226) [storm-client-2.0.1.y.jar:2.0.1.y]
Caused by: java.lang.UnsupportedOperationException
        at org.apache.storm.shade.com.google.common.collect.UnmodifiableIterator.remove(UnmodifiableIterator.java:43) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at java.util.AbstractCollection.remove(AbstractCollection.java:293) ~[?:1.8.0_102]
        at org.apache.storm.scheduler.blacklist.BlacklistScheduler.removeLongTimeDisappearFromCache(BlacklistScheduler.java:216) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.scheduler.blacklist.BlacklistScheduler.schedule(BlacklistScheduler.java:110) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.daemon.nimbus.Nimbus.computeNewSchedulerAssignments(Nimbus.java:2070) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.daemon.nimbus.Nimbus.lockingMkAssignments(Nimbus.java:2234) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.daemon.nimbus.Nimbus.mkAssignments(Nimbus.java:2220) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.daemon.nimbus.Nimbus.mkAssignments(Nimbus.java:2165) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.daemon.nimbus.Nimbus.lambda$launchServer$27(Nimbus.java:2868) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        ... 2 more
2019-02-22 10:48:41.461 o.a.s.u.Utils timer [ERROR] Halting process: Error while processing event
java.lang.RuntimeException: Halting process: Error while processing event
        at org.apache.storm.utils.Utils.exitProcess(Utils.java:520) ~[storm-client-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.daemon.nimbus.Nimbus.lambda$new$9(Nimbus.java:564) ~[storm-server-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.StormTimer$StormTimerTask.run(StormTimer.java:253) [storm-client-2.0.1.y.jar:2.0.1.y]
2019-02-22 10:48:41.462 o.a.s.u.Utils Thread-19 [INFO] Halting after 10 seconds

Issue Links

• links to: GitHub Pull Request #2961