Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
We have some scenarios requiring a rate control on # of applications submitted by the user. Currently we have to rely on the external system to limit the number of apps to prevent crash the whole livy, which brings some additional requirements like state sync between livy and rate controller
It would be great for livy to support rate limiting and it will be even better the rate control is based on the current YARN state instead of a pre-defined threshold