Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1146

FileSystem used by prepare sections should use the configuration of the action

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0, 3.2.1
    • Fix Version/s: 4.0.0
    • Component/s: action, workflow
    • Environment:

      Oozie 3.2.2, Hadoop cdh3u3

      Description

      We should be able to propagate configurations to prepare section (delete, mkdir) of action in workflow xmls.
      Though the configuration section is available per action, it is not available in for prepare tags:

      A simple use-case is to support custom filesystem by configuring the filesystem impl class in configuration, but delete prepare action is not aware of configuration set in action xml.

      Ex:<action name="myfirstHadoopJob">
      <map-reduce>
      <job-tracker>foo:9001</job-tracker>
      <name-node>bar:9000</name-node>
      <prepare>
      <delete path="hdfs://foo:9000/usr/tucu/output-data"/>
      </prepare>
      <job-xml>/myfirstjob.xml</job-xml>
      <configuration>
      <property><name>fs.s4.impl</name><value>org.apache.grid.fs.s4fs.NativeS4FileSystem</value></property>
      .....

      I think this can be fixed in FileSystemsActions.java

        Attachments

        1. OOZIE-1146-1-branch4.patch
          5 kB
          Rohini Palaniswamy
        2. OOZIE-1146-1.patch
          5 kB
          Rohini Palaniswamy

          Issue Links

            Activity

              People

              • Assignee:
                rohini Rohini Palaniswamy
                Reporter:
                shaik.idris Shaik Idris Ali
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 72h
                  72h
                  Remaining:
                  Remaining Estimate - 72h
                  72h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified