Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5353

ResourceManager can leak delegation tokens when they are shared across apps

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Recently saw a ResourceManager go into heavy GC. Heap dump showed that there were millions of delegation tokens on the heap. It looks like most of them belonged to the appTokens map in DelegationTokenRenewer. When an app completes and tokens are removed for it, I noticed that the appTokens entry for the app is not cleaned up if tokens were shared with other active apps.

        Attachments

          Activity

            People

            • Assignee:
              jlowe Jason Lowe
              Reporter:
              jlowe Jason Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: