Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2133

Support getting ATS delegation tokens for tez jobs

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 4.2.0
    • None
    • None

    Description

      Need a new server side option to enable getting delegation tokens from ATS (Application Timeline Server - generic history server for YARN Apps) for tez jobs. Putting yarn.timeline-service.enabled=true in yarn-site.xml will enable it for mapreduce jobs as well which is not needed. There are fixes being done in future releases of YARN and TEZ to not fail but just warn and proceed if they could not talk to ATS server. Since that is not available now and ATS is not stable yet in Hadoop 2.6, it is preferable to use it only for Tez jobs and not impact mapreduce jobs as jobs will fail if ATS token could not be fetched.

      Attachments

        1. OOZIE-2133-2.patch
          14 kB
          Rohini Palaniswamy
        2. OOZIE-2133-1.patch
          8 kB
          Rohini Palaniswamy

        Activity

          People

            rohini Rohini Palaniswamy
            rohini Rohini Palaniswamy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: