Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2569

Adding yarn-site, core-site, hdfs-site and mapred-site into spark launcher

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.0
    • Component/s: core
    • Labels:
      None

      Description

      Oozie Spark action requires yarn-site, core-site, hdfs-site and mapred-site to be present in the classpath for launching the spark applications. Currently we manually copy these files into oozie spark sharelib.

      Until it is fixed through the spark, we can copy the oozie.action.conf.xml file as yarn-site, core-site, hdfs-site and mapred-site, which will avoid manual steps of copying those files.

        Attachments

        1. OOZIE-2569-03.patch
          9 kB
          Abhishek Bafna
        2. OOZIE-2569-02.patch
          9 kB
          Abhishek Bafna
        3. OOZIE-2569-00.patch
          6 kB
          Abhishek Bafna

          Issue Links

            Activity

              People

              • Assignee:
                abhishekbafna Abhishek Bafna
                Reporter:
                abhishekbafna Abhishek Bafna
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: