Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
The application master will request containers while helix offline instance purging is happening.
Problem:
The helix offline instance purging is not thread safe. The desired behavior is for the yarn service to finish purging before requesting any new containers.
But currently, the yarn autoscaling manager is making calls to the yarnservice to request more containers. And this is bypassing the startup block in the startup method.
This is because the startup itself isn't synchronous. It's possible to call methods on this object before startup is complete.