-
Type:
New Feature
-
Status: Open
-
Priority:
Major
-
Resolution: Unresolved
-
Affects Version/s: None
-
Fix Version/s: 0.13.0
-
Component/s: None
-
Labels:None
In this use-case, we propose using Zookeeper for coordinating processor liveness and task distribution in a Samza job. Additionally, it opens up the possibility of allowing a flexible number of participating processors (no fixed container count).
- depends upon
-
SAMZA-1203 Use ProcessorId instead of Zk node Id in JobModel generation
-
- Resolved
-
-
SAMZA-1147 ZkJobCoordinator does not honor the interface contract of JobCoordinator
-
- Resolved
-
-
SAMZA-1173 Evaluate CoordinationService design and resolve unresolved questions from PR#91
-
- Resolved
-
-
SAMZA-1150 Handling Error propagation between ZkJobCoordinator & DebounceTimer
-
- Resolved
-
-
SAMZA-1193 Fix the flaky test TestZkBarrierForVersionUpgrade.testZkBarrierForVersionUpgrade
-
- Resolved
-
-
SAMZA-1201 Zk path setup for leader elector and barrier should be separated
-
- Resolved
-
-
SAMZA-1212 Refactor interaction between StreamProcessor, JobCoordinator and SamzaContainer
-
- Resolved
-
-
SAMZA-1241 ScheduleAfterDebounceTime thread is not shutdown when ZkJobCoordinator shutsdown
-
- Resolved
-
-
SAMZA-1272 ZkCoordinationUtils deletes the entire Zk tree on reset
-
- Resolved
-
- is related to
-
SAMZA-555 Write a ZK-based samza-standalone JobRunner
-
- Open
-
-
SAMZA-1279 list of children in onProcessorsChange throws NPE when there an exception in ZK
-
- Resolved
-
-
SAMZA-1282 Spinning up more containers than the number of tasks kills leader
-
- Resolved
-
-
SAMZA-1125 Container.shutdown() only stops the runloop
-
- Resolved
-
-
SAMZA-1343 Modify the existing failure-testing script for Zookeeper based deployment
-
- Open
-
- is required by
-
SAMZA-1063 Samza Standalone Project
-
- In Progress
-
- relates to
-
SAMZA-1344 Add retry in ApplicationRunner for failed StreamProcessors
-
- Open
-
-
SAMZA-1348 Run stop() in the StreamProcessor in the same thread as other events.
-
- Open
-
-
SAMZA-1301 Investigate ZKClient exceptions in ZkJobCoordinator.
-
- Open
-
-
SAMZA-1382 Support for ZK communication version protocol.
-
- Resolved
-
-
SAMZA-1302 Improve Zookeeper error handling
-
- Resolved
-
-
SAMZA-1304 Improve duplicate processors detection
-
- Resolved
-
-
SAMZA-1338 Number of processors greater then number of tasks results in an incorrect behavior.
-
- Closed
-
-
SAMZA-1368 make sure that a new job model will be generated if zk barrier times out.
-
- Closed
-
-
SAMZA-1041 Multi-stage feature for Samza
-
- In Progress
-
-
SAMZA-1349 Fix stop() sequence in the StreamProcessor
-
- Open
-
-
SAMZA-1303 Request for waitForFinish(time, TimeUnit) api in LocalApplicationRunner
-
- Closed
-
- requires
-
SAMZA-1084 User thread does not see errors from the processor thread when using the StreamProcessor API
-
- Resolved
-
- links to