Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10333

YarnClient obtain Delegation Token for Log Aggregation Path

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.4.0
    • Component/s: log-aggregation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      There are use cases where Yarn Log Aggregation Path is configured to a FileSystem like S3 or ABFS different from what is configured in fs.defaultFS (HDFS). Log Aggregation fails as the client has token only for fs.defaultFS and not for log aggregation path.

      This Jira is to improve YarnClient by obtaining delegation token for log aggregation path and add it to the Credential of Container Launch Context similar to how it does for Timeline Delegation Token.

        Attachments

        1. YARN-10333-001.patch
          5 kB
          Prabhu Joseph
        2. YARN-10333-002.patch
          12 kB
          Prabhu Joseph
        3. YARN-10333-003.patch
          12 kB
          Prabhu Joseph

        Issue Links

          Activity

            People

            • Assignee:
              prabhujoseph Prabhu Joseph
              Reporter:
              prabhujoseph Prabhu Joseph

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment