[SAMZA-2373] Container Placements API for container move and restart

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Assignee: Sanil Jain
• Reporter: Sanil Jain
• Created: 06/Nov/19 18:14
• Updated: 18/Feb/20 22:33
• Resolved: 18/Feb/20 22:33

Description

Design: SEP-22: Container Placements in Samza

Changes: : Following abilities are added as a part of this PR:

1. Container placement service core functionality to the Job Coordinator code
2. Ability to move containers to any / specific host for host affinity enabled jobs
3. Ability to move containers to any host only for host affinity disabled jobs
4. Standby enabled jobs are not supported in the PR (will follow with the stacked PR)

Tests:

1. Unit tests are added to moc and end to end control action and behavior
2. Manual testing matrix: Container Placement Test Plan

API Changes::

1. This PR introduces behavior changes when a control action is active on job coordinator in such scenario the JC will try to reserve resources for the request, if it gets the resources it it attempts to stop the active container then attempts to start on the allocated resouces
2. All the state realted to control actions are mainted in memory in the JC, followed up by reporting & cleanup as soon as the control action finished

Upgrade Instructions: None

Usage Instructions: The ability to access these apis will be added as a part of follow up PR

RB: https://github.com/apache/samza/pull/1219

 

Issue Links

• links to: GitHub Pull Request #1219