Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4860

DelegationTokenRenewal attempts to renew token even after a job is removed

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.1
    • 1.2.0
    • security
    • None
    • Reviewed

    Description

      mapreduce.security.token.DelegationTokenRenewal synchronizes on removeDelegationToken, but fails to synchronize on addToken, and renewing tokens in run().

      This inconsistency is exposed by frequent failures of TestDelegationTokenRenewal:

      Error Message

renew wasn't called as many times as expected expected:<4> but was:<5>
Stacktrace

junit.framework.AssertionFailedError: renew wasn't called as many times as expected expected:<4> but was:<5>
	at org.apache.hadoop.mapreduce.security.token.TestDelegationTokenRenewal.testDTRenewal(TestDelegationTokenRenewal.java:317)
	at org.apache.hadoop.mapreduce.security.token.TestDelegationTokenRenewal.testDTRenewalAfterClose(TestDelegationTokenRenewal.java:338)

      Attachments

        1. mr-4860.patch
          1 kB
          Karthik Kambatla
        2. mr-4860.patch
          1 kB
          Karthik Kambatla
        3. mr-4860.patch
          2 kB
          Karthik Kambatla
        4. mr-4860.patch
          3 kB
          Karthik Kambatla
        5. mr-4860.patch
          4 kB
          Karthik Kambatla

        Issue Links

          is cloned by

          Bug - A problem which impairs or prevents the functions of the product. YARN-264 y.s.rm.DelegationTokenRenewer attempts to renew token even after removing an app

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5384 Races in DelegationTokenRenewal

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-4861 Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5364 Deadlock between RenewalTimerTask methods cancel() and run()

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-4795 TestDelegationTokenRenewal should not use static variables in Renewer

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              kasha Karthik Kambatla
              kasha Karthik Kambatla
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: