Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2133

Support getting ATS delegation tokens for tez jobs

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.2.0
    • Component/s: None
    • Labels:
      None

      Description

      Need a new server side option to enable getting delegation tokens from ATS (Application Timeline Server - generic history server for YARN Apps) for tez jobs. Putting yarn.timeline-service.enabled=true in yarn-site.xml will enable it for mapreduce jobs as well which is not needed. There are fixes being done in future releases of YARN and TEZ to not fail but just warn and proceed if they could not talk to ATS server. Since that is not available now and ATS is not stable yet in Hadoop 2.6, it is preferable to use it only for Tez jobs and not impact mapreduce jobs as jobs will fail if ATS token could not be fetched.

        Attachments

        1. OOZIE-2133-2.patch
          14 kB
          Rohini Palaniswamy
        2. OOZIE-2133-1.patch
          8 kB
          Rohini Palaniswamy

          Activity

            People

            • Assignee:
              rohini Rohini Palaniswamy
              Reporter:
              rohini Rohini Palaniswamy
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: