Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4069

Cleanup task tokens interface

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 0.23.2
    • None
    • mrv2
    • None

    Description

      This tracks a couple of cleanup issues that were identified in MAPREDUCE-4043:

      • It seems unnecessary to pass the job token and credentials separately when we always combine the job token into the credentials before building the container launch context. The TaskImpl and TaskAttemptImpl constructors could simply take credentials with the job token already added rather than separate job token and credential parameters.
      • It's unclear whether we still need the appTokens file that is placed into HDFS by the job submitter, localized by the NM, and finally read in by the AM. I believe the AM's credentials sent in the AM's container launch context already contains the same information. If that's the case, we should remove the code related to the appTokens file.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: