Oozie
  1. Oozie
  2. OOZIE-39

Oozie example docs may be unclear on the placements of the job.properties file

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: pre-Apache
    • Component/s: None
    • Labels:

      Description

      The 'Running the Example' docs go as:

      Add Oozie bin/ to the environment PATH.
      
      The examples assume the JobTracker is localhost:9001 and the NameNode is hdfs://localhost:9000 . If the actual values are different, the job properties files in the examples directory must be edited to the correct values.
      
      The example applications are under the examples/app directory, one directory per example. The directory contains the application XML file (workflow, or worklfow and coordinator), the job.properties file to submit the job and any JAR files the example may need.
      
      The inputs for all examples are in the examples/input-data/ directory.
      
      The examples create output under the examples/output-data/${EXAMPLE_NAME} directory.
      

      It isn't specified clearly, after the step of placing the examples in HDFS, that the job.properties file is actually something per-user, and is client-side as a local file and not something that needs to be a HDFS path. This could mislead users into initially thinking that the job.properties path provided to run an example would require to be on HDFS.

      In any case, we could benefit by adding a docnote on explicitly stating that the job properties is a local file prepared by the user.

        Activity

        Hide
        Harsh J added a comment -

        Patch that adds a doc change to explicitly state the above described.

        Show
        Harsh J added a comment - Patch that adds a doc change to explicitly state the above described.
        Hide
        Harsh J added a comment -

        (Dunno how to assign to self… It wasn't allowed on the Oozie original jira too I think? Part of dev process?)

        Anyhow, please consider this as 'Patch Available'

        Show
        Harsh J added a comment - (Dunno how to assign to self… It wasn't allowed on the Oozie original jira too I think? Part of dev process?) Anyhow, please consider this as 'Patch Available'
        Hide
        Alejandro Abdelnur added a comment -

        I can get to the assign via the Edit button, but maybe because I'm a project admin.

        I guess we have to setup/configure a JIRA Workflow.

        Harsh, I cannot find your name in the drop down list Jira offers, and there is not text entry.

        Show
        Alejandro Abdelnur added a comment - I can get to the assign via the Edit button, but maybe because I'm a project admin. I guess we have to setup/configure a JIRA Workflow. Harsh, I cannot find your name in the drop down list Jira offers, and there is not text entry.
        Hide
        Harsh J added a comment -

        IIRC, someone had to add a person as a 'contributor' in jira somewhere to put onto that list. I'm not present cause this is my first entry in apache JIRA for oozie, and I haven't been added/registered yet. No sweat though, as long as the patch is OK and the repos are ready to go

        Show
        Harsh J added a comment - IIRC, someone had to add a person as a 'contributor' in jira somewhere to put onto that list. I'm not present cause this is my first entry in apache JIRA for oozie, and I haven't been added/registered yet. No sweat though, as long as the patch is OK and the repos are ready to go
        Hide
        Mohammad Kamrul Islam added a comment -

        Is it possible to send the patch through review board?

        Show
        Mohammad Kamrul Islam added a comment - Is it possible to send the patch through review board?
        Hide
        Harsh J added a comment -

        Sure, since you ask so. I'm wondering what to place in the "Base Diff Path" though. I tried " /incubator/oozie/trunk" but to no avail.

        Show
        Harsh J added a comment - Sure, since you ask so. I'm wondering what to place in the "Base Diff Path" though. I tried " /incubator/oozie/trunk" but to no avail.
        Show
        Mohammad Kamrul Islam added a comment - I gave this: http://svn.apache.org/repos/asf/incubator/oozie/trunk
        Hide
        Harsh J added a comment -

        Thanks. Been long since I used an svn based reviewboard.

        Here is the oneliner: https://reviews.apache.org/r/2043/

        Show
        Harsh J added a comment - Thanks. Been long since I used an svn based reviewboard. Here is the oneliner: https://reviews.apache.org/r/2043/
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/2043/
        -----------------------------------------------------------

        Review request for oozie and Mohammad Islam.

        Summary
        -------

        Trivial docfix patch that prevents users from thinking that properties file needs to be on HDFS.

        This addresses bug OOZIE-39.
        https://issues.apache.org/jira/browse/OOZIE-39

        Diffs


        http://svn.apache.org/repos/asf/incubator/oozie/trunk/docs/src/site/twiki/DG_Examples.twiki 1175131

        Diff: https://reviews.apache.org/r/2043/diff

        Testing
        -------

        Thanks,

        Harsh

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2043/ ----------------------------------------------------------- Review request for oozie and Mohammad Islam. Summary ------- Trivial docfix patch that prevents users from thinking that properties file needs to be on HDFS. This addresses bug OOZIE-39 . https://issues.apache.org/jira/browse/OOZIE-39 Diffs http://svn.apache.org/repos/asf/incubator/oozie/trunk/docs/src/site/twiki/DG_Examples.twiki 1175131 Diff: https://reviews.apache.org/r/2043/diff Testing ------- Thanks, Harsh
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/2043/#review2294
        -----------------------------------------------------------

        Ship it!

        Will push

        • Mohammad

        On 2011-09-24 09:24:19, Harsh J wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/2043/

        -----------------------------------------------------------

        (Updated 2011-09-24 09:24:19)

        Review request for oozie and Mohammad Islam.

        Summary

        -------

        Trivial docfix patch that prevents users from thinking that properties file needs to be on HDFS.

        This addresses bug OOZIE-39.

        https://issues.apache.org/jira/browse/OOZIE-39

        Diffs

        -----

        http://svn.apache.org/repos/asf/incubator/oozie/trunk/docs/src/site/twiki/DG_Examples.twiki 1175131

        Diff: https://reviews.apache.org/r/2043/diff

        Testing

        -------

        Thanks,

        Harsh

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2043/#review2294 ----------------------------------------------------------- Ship it! Will push Mohammad On 2011-09-24 09:24:19, Harsh J wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2043/ ----------------------------------------------------------- (Updated 2011-09-24 09:24:19) Review request for oozie and Mohammad Islam. Summary ------- Trivial docfix patch that prevents users from thinking that properties file needs to be on HDFS. This addresses bug OOZIE-39 . https://issues.apache.org/jira/browse/OOZIE-39 Diffs ----- http://svn.apache.org/repos/asf/incubator/oozie/trunk/docs/src/site/twiki/DG_Examples.twiki 1175131 Diff: https://reviews.apache.org/r/2043/diff Testing ------- Thanks, Harsh
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/2043/#review2415
        -----------------------------------------------------------

        Committed. please close the review request.

        • Mohammad

        On 2011-09-24 09:24:19, Harsh J wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/2043/

        -----------------------------------------------------------

        (Updated 2011-09-24 09:24:19)

        Review request for oozie and Mohammad Islam.

        Summary

        -------

        Trivial docfix patch that prevents users from thinking that properties file needs to be on HDFS.

        This addresses bug OOZIE-39.

        https://issues.apache.org/jira/browse/OOZIE-39

        Diffs

        -----

        http://svn.apache.org/repos/asf/incubator/oozie/trunk/docs/src/site/twiki/DG_Examples.twiki 1175131

        Diff: https://reviews.apache.org/r/2043/diff

        Testing

        -------

        Thanks,

        Harsh

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2043/#review2415 ----------------------------------------------------------- Committed. please close the review request. Mohammad On 2011-09-24 09:24:19, Harsh J wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2043/ ----------------------------------------------------------- (Updated 2011-09-24 09:24:19) Review request for oozie and Mohammad Islam. Summary ------- Trivial docfix patch that prevents users from thinking that properties file needs to be on HDFS. This addresses bug OOZIE-39 . https://issues.apache.org/jira/browse/OOZIE-39 Diffs ----- http://svn.apache.org/repos/asf/incubator/oozie/trunk/docs/src/site/twiki/DG_Examples.twiki 1175131 Diff: https://reviews.apache.org/r/2043/diff Testing ------- Thanks, Harsh
        Hide
        Harsh J added a comment -

        Fixed in trunk.

        Show
        Harsh J added a comment - Fixed in trunk.
        Hide
        Harsh J added a comment -

        For the patch committed in trunk with this JIRA ID (also available under the same JIRA ID in Apache ReviewBoard system), I grant license to ASF for inclusion in ASF works (as per the Apache License §5)

        Show
        Harsh J added a comment - For the patch committed in trunk with this JIRA ID (also available under the same JIRA ID in Apache ReviewBoard system), I grant license to ASF for inclusion in ASF works (as per the Apache License §5)

          People

          • Assignee:
            Unassigned
            Reporter:
            Harsh J
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 2m
              2m
              Remaining:
              Remaining Estimate - 2m
              2m
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development