[STORM-1976] Storm Nimbus H/A has issue on cleaning corrupted topologies

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.0.0, 1.0.1
• Fix Version/s: 2.0.0, 1.0.2, 1.1.0
• Component/s: storm-core
• Assignee: Jungtaek Lim
• Reporter: Raghav Kumar Gautam
• Created: 17/Jul/16 07:03
• Updated: 21/Jul/16 16:05
• Resolved: 19/Jul/16 23:32

Description

In the following scenario storm-ha runs into issues:
1. Kill a non-leader nimbus
2. Submit a topology
3. Bring up the non-leader nimbus

After step-3 expectation is that the non-leader nimbus will download topology jar. Instead it cleans up the topology.

2016-07-12 07:11:09.511 o.a.s.c.zookeeper-state-factory [WARN] Received event ::none: with disconnected Reader Zookeeper.
2016-07-12 07:11:09.587 o.a.s.zookeeper [INFO] Queued up for leader lock.
2016-07-12 07:11:09.608 o.a.s.d.nimbus [INFO] Corrupt topology JoinedNonLeaderNimbusTriesToDownloadTopologyCode-2-1468307239 has state on zookeeper but doesn't have a local dir on Nimbus. Cleaning up...
2016-07-12 07:11:09.932 o.a.h.m.s.s.StormTimelineMetricsReporter [INFO] Preparing Storm Metrics Reporter
2016-07-12 07:11:09.946 o.a.s.d.m.MetricsUtils [INFO] Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter

Issue Links

• is related to: STORM-1977 Leader Nimbus crashes with getClusterInfo when it doesn't have one or more replicated topology codes
• links to: GitHub Pull Request #1571
• links to: GitHub Pull Request #1572