Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10333

YarnClient obtain Delegation Token for Log Aggregation Path

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.4.0
    • Component/s: log-aggregation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      There are use cases where Yarn Log Aggregation Path is configured to a FileSystem like S3 or ABFS different from what is configured in fs.defaultFS (HDFS). Log Aggregation fails as the client has token only for fs.defaultFS and not for log aggregation path.

      This Jira is to improve YarnClient by obtaining delegation token for log aggregation path and add it to the Credential of Container Launch Context similar to how it does for Timeline Delegation Token.

        Attachments

        1. YARN-10333-003.patch
          12 kB
          Prabhu Joseph
        2. YARN-10333-002.patch
          12 kB
          Prabhu Joseph
        3. YARN-10333-001.patch
          5 kB
          Prabhu Joseph

          Activity

            People

            • Assignee:
              prabhujoseph Prabhu Joseph
              Reporter:
              prabhujoseph Prabhu Joseph
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: