XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 5.0.0
    • 5.0.0b1
    • None
    • None

    Description

      In MapReduce, you can define ACL-related properties:

      mapreduce.job.acl-view-job
      mapreduce.job.acl-modify-job
      

      acl-view-job defines a list of users/groups who can retrieve the job statistics. acl-modify-job defines a list of users/groups who can kill a job or adjust the priority of it.
      Docs: https://hadoop.apache.org/docs/r1.2.1/mapred_tutorial.html#Job+Authorization

      In YARN, we can provide backward compatibility for these properties. Example code:

      Map<ApplicationAccessType, String> acls = new HashMap<ApplicationAccessType, String>();
      acls.put(ApplicationAccessType.MODIFY_APP, "*");
      acls.put(ApplicationAccessType.VIEW_APP, "*");
      amContainer.setApplicationACLs(acls);
      

      This has to be done before application submission. We have to do what YARNRunner.java does: https://github.com/apache/hadoop/blob/3721cfe1fbd98c5b6aa46aefdfcf62276c28c4a4/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java#L502-L507

      We should also ensure the compatibility with the properties of:
      mapreduce.job.acl-view-job
      mapreduce.job.acl-modfy-job

      Attachments

        1. OOZIE-2897-001.patch
          14 kB
          Peter Bacsko
        2. OOZIE-2897-002.patch
          20 kB
          Peter Bacsko
        3. OOZIE-2897-003.patch
          18 kB
          Peter Bacsko
        4. OOZIE-2897-004.patch
          28 kB
          Peter Bacsko
        5. OOZIE-2897-005.patch
          29 kB
          Peter Bacsko
        6. OOZIE-2897-006.patch
          28 kB
          Peter Bacsko

        Issue Links

          Activity

            People

              pbacsko Peter Bacsko
              pbacsko Peter Bacsko
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: