Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3439

RM fails to renew token when Oozie launcher leaves before sub-job finishes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Duplicate
    • 2.7.0
    • None
    • resourcemanager
    • None

    Description

      When the Oozie launcher runs a standard MapReduce job (not Pig) it doesn't linger waiting for the sub-job to finish. At that point the RM stops renewing delegation tokens for the launcher job which wreaks havoc on the sub-job if the sub-job runs long enough for the tokens to expire.

      Attachments

        1. YARN-3439.001.patch
          20 kB
          Jason Darrell Lowe

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. YARN-3055 The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is broken by

          Sub-task - The sub-task of the issue YARN-2704 Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-2964 RM prematurely cancels tokens for jobs that submit jobs (oozie)

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              daryn Daryn Sharp
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: