Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1063

Provide documentation on configuring Oozie to use new Hadoop API

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • docs
    • None

    Description

      To use the newer mapreduce.* Hadoop API, the Oozie workflow XML configuration should have the mapred.mapper|reducer.new-api property set to true. This is currently undocumented (on the Oozie side), and throws mysterious RuntimeExceptions when using the newer API.

      Example RuntimeExceptions:

      java.lang.RuntimeException: class com.foo.bar.SomeMapper not org.apache.hadoop.mapred.Mapper

      java.lang.RuntimeException: class com.foo.bar.SomeOutputFormat not org.apache.hadoop.mapred.OutputFormat

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              michaelk Michael Katzenellenbogen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: