Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
TEZ-2003
-
None
-
None
-
None
Description
TaskCommunicator
// - registerContainerEnd should provide the end reason / possible rename
// - get rid of getAddress
// - Add methods to support task preemption
// - Add a dagStarted notification, along with a payload
TaskCommunicatorContext
// - Consolidate usage of IDs
// - Split the heartbeat API to a liveness check and a status update
// - Rename and consolidate TaskHeartbeatResponse and TaskHeartbeatRequest
// - Fix taskStarted needs to be invoked before launching the actual task.
// - Potentially add methods to report availability stats to the scheduler
// - Report taskSuccess via a method instead of the heartbeat
// - Add methods to signal container / task state changes
// - Maybe add book-keeping as a helper library, instead of each impl tracking container to task etc.
// - Handling of containres / tasks which no longer exist in the system (formalized interface instead of a shouldDie notification)