Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
0.11.0
-
None
-
None
-
None
Description
Currently, YarnTwillRunnerService renews delegation tokens for the running applications in a serial fashion:
https://github.com/apache/twill/blob/2a316a60b041f39bff95bfcd45f308f7c89d4bfa/twill-yarn/src/main/java/org/apache/twill/yarn/YarnTwillRunnerService.java#L702-L721
If there are many applications running, this can take a long time. These renew tasks can be done in parallel to speed this up.