Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10333

YarnClient obtain Delegation Token for Log Aggregation Path

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.4.0
    • Component/s: log-aggregation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      There are use cases where Yarn Log Aggregation Path is configured to a FileSystem like S3 or ABFS different from what is configured in fs.defaultFS (HDFS). Log Aggregation fails as the client has token only for fs.defaultFS and not for log aggregation path.

      This Jira is to improve YarnClient by obtaining delegation token for log aggregation path and add it to the Credential of Container Launch Context similar to how it does for Timeline Delegation Token.

        Attachments

        1. YARN-10333-003.patch
          12 kB
          Prabhu Joseph
        2. YARN-10333-002.patch
          12 kB
          Prabhu Joseph
        3. YARN-10333-001.patch
          5 kB
          Prabhu Joseph

          Issue Links

            Activity

              People

              • Assignee:
                prabhujoseph Prabhu Joseph
                Reporter:
                prabhujoseph Prabhu Joseph
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: