Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2631

Support both old and new Hadoop/HBase APIs with OozieActionConfigurator

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • action
    • None

    Description

      I was recently trying to set up an MR job initialized with TableMapReduceUtil to be ran by Oozie. Oozie offers a way to configure the job by providing an implementation of org.apache.oozie.action.hadoop.OozieActionConfigurator (introduced in SOC-1954). Unfortunately, this interface is using org.apache.hadoop.mapred.JobConf, not Job. In Hbase there are two classes: org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil (new API) and org.apache.hadoop.hbase.mapred.TableMapReduceUtil (old API). New API is using org.apache.hadoop.mapreduce.Job everywhere where old API used JobConf. I believe it would be a good idea to improve the action configurator so it could accept either JobConf or Job. Maybe a way to go is to subclass OozieActionConfigurator and introduce a new interface like "OozieMapReduceActionConfigurator" that would provide configure() method accepting org.apache.hadoop.mapreduce.Job?

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ngrigoriev@gmail.com Nikolai Grigoriev
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: