Uploaded image for project: 'Apache Twill (Retired)'
  1. Apache Twill (Retired)
  2. TWILL-231

YarnTwillRunnerService should renew delegation tokens in parallel

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.11.0
    • None
    • None
    • None

    Description

      Currently, YarnTwillRunnerService renews delegation tokens for the running applications in a serial fashion:
      https://github.com/apache/twill/blob/2a316a60b041f39bff95bfcd45f308f7c89d4bfa/twill-yarn/src/main/java/org/apache/twill/yarn/YarnTwillRunnerService.java#L702-L721

      If there are many applications running, this can take a long time. These renew tasks can be done in parallel to speed this up.

      Attachments

        Activity

          People

            Unassigned Unassigned
            anwar1 Ali Anwar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: