[MESOS-2308] Task reconciliation API should support data partitioning

• Type: Story
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Bill Farner
• Shepherd: Vinod Kone
• Created: 30/Jan/15 22:25
• Updated: 06/Oct/16 16:38

Description

The reconcileTasks API call requires the caller to specify a collection of {{TaskStatus}}es, with the option to provide an empty collection to retrieve the master's entire state. Retrieving the entire state is the only mechanism for the scheduler to learn that there are tasks running it does not know about, however this call does not allow incremental querying. The result would be that the master may need to send many thousands of status updates, and the scheduler would have to handle them. It would be ideal if the scheduler had a means to partition these requests so it can control the pace of these status updates.

Issue Links

• is related to: MESOS-5950 Consider request/response for reconciliation, bulk reconcile
• is superceded by: MESOS-2347 Add ability for schedulers to explicitly acknowledge status updates on the driver.