Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5870

Support for passing Job priority through Application Submission Context in Mapreduce Side

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • client
    • None
    • Reviewed

    Description

      Job Priority support in MapReduce.

      1. Job Priority can be set from client side as below (Configuration and api).

      • JobConf.getJobPriority() and JobConf.setJobPriority(JobPriority priority)
      • We can also use configuration "mapreduce.job.priority".

      Now this Job priority can be passed in Application Submission context from Client side.
      Here we can reuse the MRJobConfig.PRIORITY configuration.
      2. CLI changes to support --set-priority. Run time change of JobPriority is also to be handled.
      3. Change Job to have the support for setPriority and getPriority (getter is handled with JobStatus)

      Attachments

        1. Yarn-2002.1.patch
          2 kB
          Sunil G
        2. 0001-MAPREDUCE-5870.patch
          3 kB
          Sunil G
        3. 0002-MAPREDUCE-5870.patch
          6 kB
          Sunil G
        4. 0003-MAPREDUCE-5870.patch
          6 kB
          Sunil G
        5. 0004-MAPREDUCE-5870.patch
          13 kB
          Sunil G
        6. 0005-MAPREDUCE-5870.patch
          32 kB
          Sunil G
        7. 0006-MAPREDUCE-5870.patch
          32 kB
          Sunil G
        8. 0007-MAPREDUCE-5870.patch
          29 kB
          Sunil G
        9. 0008-MAPREDUCE-5870.patch
          33 kB
          Sunil G
        10. 0009-MAPREDUCE-5870.patch
          33 kB
          Sunil G
        11. 0010-MAPREDUCE-5870.patch
          34 kB
          Sunil G
        12. 0011-MAPREDUCE-5870.patch
          36 kB
          Sunil G
        13. 0012-MAPREDUCE-5870.patch
          36 kB
          Sunil G

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-4014 Support user cli interface in for Application Priority

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6515 Update Application priority in AM side from AM-RM heartbeat

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-1963 Support priorities across applications within the same queue

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              sunilg Sunil G
              sunilg Sunil G
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: