Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3551

Spark shouldn't obtain tokens withing the Spark action

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 5.3.0
    • None
    • None

    Description

      Task:
      Add the following to the spark opts section of the spark action
      --conf spark.yarn.security.tokens.hiveserver2.enabled=false --conf spark.yarn.security.tokens.hivestreaming.enabled=false

      Issue:
      If Spark is launched form Oozie then we need to turn these 2 and some others off: http://spark.apache.org/docs/latest/running-on-yarn.html#launching-your-application-with-apache-oozie and let Oozie obtain the tokens.

      Attachments

        1. OOZIE-3551-1.patch
          9 kB
          Liz Szilagyi
        2. OOZIE-3551-2.patch
          10 kB
          Liz Szilagyi

        Activity

          People

            z17 Liz Szilagyi
            z17 Liz Szilagyi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: