Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2889

Address remaining OYA issues

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In the review https://reviews.apache.org/r/54705/ we identified several issues which should be handled in order to have a working OYA implementation. Some of them are more critical then others.

      This is an umbrella JIRA for all the remaining problems that the reviewers spotted.

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. OOZIE-1770 Create Oozie Application Master for YARN

          • Major - Major loss of function.
          • Closed
          1.
          		 LauncherAM: rewrite UGI calls Sub-task Closed Andras Piros
          2.
          		 Make sure Java action can submit MR jobs on secure clusters Sub-task Resolved Peter Bacsko
          3.
          		 Ensure compatibility for existing LauncherMapper settings Sub-task Closed Andras Piros
          4.
          		 Re-add testChildKill and adapt it to OYA Sub-task Closed Peter Bacsko
          5.
          		 Re-add test testWfActionKillChildJob and adapt it to OYA Sub-task Closed Gézapeti
          6.
          		 Fix race conditon in check() methods and rewrite check() logic Sub-task Open Unassigned
          7.
          		 Implement the equivalent of mapreduce.task.classpath.user.precedence Sub-task Open Unassigned
          8.
          		 Implement the equivalent of mapreduce.job.classloader and mapreduce.job.classloader.system.classes Sub-task Open Unassigned
          9.
          		 Implement the equivalent of mapred.job.priority Sub-task Resolved Unassigned
          10.
          		 Take heartbeat setting from mapred property Sub-task Resolved Unassigned
          11.
          		 LauncherAM should support ACLs Sub-task Closed Peter Bacsko
          12.
          		 Implement the equivalent of mapreduce.job.acl-view-job and mapreduce.job.acl-modify-job Sub-task Resolved Unassigned
          13.
          		 Create XML schema for launcher configurations Sub-task Closed Attila Sasvári
          14.
          		 Retrieve tokens from ATS before submission Sub-task Open Unassigned
          15.
          		 Retrieve tokens for oozie.launcher.mapreduce.job.hdfs-servers before submission Sub-task Closed Attila Sasvári
          16.
          		 cancel delegation tokens after an action is finished Sub-task Closed Unassigned
          17.
          		 Define proper naming of Launcher jobs in YARN Sub-task Open Unassigned
          18.
          		 TestLauncherAM: discuss a failing situation (url callback: successful, but unregister fails) Sub-task Open Unassigned
          19.
          		 OYA: Find places where to add MR specific classes/configs instead of handling them in JavaActionExecutor Sub-task Resolved Peter Bacsko
          20.
          		 Finished Launcher jobs should be fetched from AHS if they're finished Sub-task Open Unassigned
          21.
          		 OYA: Misc code cleanup Sub-task Open Unassigned
          22.
          		 Use Log4j in LauncherAM Sub-task Resolved Unassigned
          23.
          		 Ability to add/remove MapReduce jars from action classpath. Sub-task Closed Andras Piros
          24.
          		 Delete PrepareActionsDriver from oozie-sharelib Sub-task Closed Andras Salamon
          25.
          		 Adapt uber mode tests to OYA Sub-task Open Unassigned
          26.
          		 Investigate if DistCpActionExecutor works as expected Sub-task Resolved Unassigned
          27.
          		 Set a job name for the MR Action's child job Sub-task Closed Attila Sasvári
          28.
          		 Delete LauncherMapper and its test Sub-task Closed Attila Sasvári
          29.
          		 OYA: Update Documentation Sub-task Closed Andras Piros
          30.
          		 OYA: Refactor JavaActionExecutor and executor class hierarchy Sub-task Open Unassigned
          31.
          		 OYA: Update example workflows to newest schemas Sub-task Closed Attila Sasvári
          32.
          		 Old map-reduce workflow example can't work with OYA Sub-task Open Unassigned
          33.
          		 Shell action example does not work with Oozie on Yarn on hadoop 2.6 Sub-task Closed Attila Sasvári
          34.
          		 Stream the Launcher AM Logs Sub-task Open Unassigned
          35.
          		 Hive2Credentials should not add principal to jdbc Url twice Sub-task Resolved Unassigned
          36.
          		 Environmental variables should be separated by comma (,) Sub-task Open Unassigned
          37.
          		 Cut out the creation of AppSubmissionContext from JavaActionExecutor Sub-task Open Unassigned
          38.
          		 Extend remaining job tracker references in code and documentation Sub-task Open Unassigned

          Activity

            People

              Unassigned Unassigned
              pbacsko Peter Bacsko
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: