[STORM-885] Heartbeat Server (Pacemaker)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: storm-core
• Assignee: Kyle Nusbaum
• Reporter: Robert Joseph Evans
• Created: 18/Jun/15 20:51
• Updated: 25/Aug/16 16:01
• Resolved: 23/Nov/15 21:50

Description

Large highly connected topologies and large clusters write a lot of data into ZooKeeper. The heartbeats, that make up the majority of this data, do not need to be persisted to disk. Pacemaker is intended to be a secure replacement for storing the heartbeats without changing anything within the heartbeats. In the future as more metrics are added in, we may want to look into switching it over to look more like Heron, where a metrics server is running for each node/topology. And can be used to aggregate/per-aggregate them in a more scalable manor.

Issue Links

• blocks: STORM-921 Create unit tests for worker-worker netty authentication.
• incorporates: STORM-872 Expose interfaces to give users opportunity to customize "executor" heartbeat module
• links to: GitHub Pull Request #838
• mentioned in: Page Loading...