Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5870

Support for passing Job priority through Application Submission Context in Mapreduce Side

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Job Priority support in MapReduce.

      1. Job Priority can be set from client side as below (Configuration and api).

      • JobConf.getJobPriority() and JobConf.setJobPriority(JobPriority priority)
      • We can also use configuration "mapreduce.job.priority".

      Now this Job priority can be passed in Application Submission context from Client side.
      Here we can reuse the MRJobConfig.PRIORITY configuration.
      2. CLI changes to support --set-priority. Run time change of JobPriority is also to be handled.
      3. Change Job to have the support for setPriority and getPriority (getter is handled with JobStatus)

        Attachments

        1. Yarn-2002.1.patch
          2 kB
          Sunil Govindan
        2. 0012-MAPREDUCE-5870.patch
          36 kB
          Sunil Govindan
        3. 0011-MAPREDUCE-5870.patch
          36 kB
          Sunil Govindan
        4. 0010-MAPREDUCE-5870.patch
          34 kB
          Sunil Govindan
        5. 0009-MAPREDUCE-5870.patch
          33 kB
          Sunil Govindan
        6. 0008-MAPREDUCE-5870.patch
          33 kB
          Sunil Govindan
        7. 0007-MAPREDUCE-5870.patch
          29 kB
          Sunil Govindan
        8. 0006-MAPREDUCE-5870.patch
          32 kB
          Sunil Govindan
        9. 0005-MAPREDUCE-5870.patch
          32 kB
          Sunil Govindan
        10. 0004-MAPREDUCE-5870.patch
          13 kB
          Sunil Govindan
        11. 0003-MAPREDUCE-5870.patch
          6 kB
          Sunil Govindan
        12. 0002-MAPREDUCE-5870.patch
          6 kB
          Sunil Govindan
        13. 0001-MAPREDUCE-5870.patch
          3 kB
          Sunil Govindan

          Issue Links

            Activity

              People

              • Assignee:
                sunilg Sunil Govindan
                Reporter:
                sunilg Sunil Govindan
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: