Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1687

Stress submission policy does not always stress the cluster.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • contrib/gridmix
    • None

    Description

      Currently, the rough idea of stress submission policy is to continue submitting jobs until the pending map tasks reach 2x of the cluster capacity. This proves to be inadequate and we saw a large job could monopolize the whole cluster.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-3481 [Gridmix] Improve STRESS mode locking

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-3769 [Gridmix] Improve the way job monitor maintains running jobs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              amar_kamat Amar Kamat
              hong.tang Hong Tang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: