Description
In the fine grained scheduling implementation, when YARN scheduler allocates a container, Myriad launches a pseudo Mesos task for it by specifying its resource allocation. When the container completes, a task finished update is sent to Mesos so that the pseudo task is stopped and its resources reclaimed. When there are pending tasks in the YARN scheduler’s pipeline, it would be beneficial to hold on to these resources and see if it can be used again. This avoids the overhead of giving away resources and waiting for Mesos to offer it back.