Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5065

Umbrella JIRA of SLS fixes / improvements

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • scheduler-load-simulator
    • None

    Description

      Umbrella JIRA to track SLS (scheduler load simulator) fixes and improvements.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. YARN-3767 Yarn Scheduler Load Simulator does not work

          • Major - Major loss of function.
          • Resolved
          1.
          		 Queue metrics of SLS capacity scheduler only activated after app submit to the queue Sub-task Resolved Jonathan Hung
          2.
          		 SLS MRAMSimulator should include scheduledMappers/Reducers when re-request failed tasks Sub-task Resolved Wangda Tan
          3.
          		 Support specifying resources for task containers in SLS Sub-task Resolved Wangda Tan
          4.
          		 Fix AM container allocation logic in SLS Sub-task Resolved Wangda Tan
          5.
          		 Support specifying resources for AM containers in SLS Sub-task Resolved Yufei Gu
          6.
          		 Fix issues Rumen to SLS converter Sub-task Open Prabhu Joseph
          7.
          		 Not be able to run SLS with FairScheduler Sub-task Resolved Yufei Gu
          8.
          		 Fail to launch SLSRunner due to NPE Sub-task Resolved Kai
          9.
          		 Fail to show real-time tracking charts in SLS Sub-task Resolved Yufei Gu
          10.
          		 The log4j.properties in sample-conf doesn't work well for SLS Sub-task Open Prabhu Joseph
          11.
          		 Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS Sub-task Resolved Yufei Gu
          12.
          		 Not be able to run SLS with FifoScheduler Sub-task Open Prabhu Joseph
          13.
          		 Queue metrics doesn't work for Fair Scheduler in SLS Sub-task Resolved Yufei Gu
          14.
          		 Better unit test coverage required for SLS Sub-task Open Wangda Tan
          15.
          		 The SLS offline mode doesn't work Sub-task Open Prabhu Joseph
          16.
          		 Define the strings used in SLS JSON input file format Sub-task Resolved Gergely Novák
          17.
          		 Fix the code vulnerability of org.apache.hadoop.yarn.sls.SLSRunner.simulateInfoMap Sub-task Resolved Unassigned
          18.
          		 Make SLS JSON input file format simple and scalable Sub-task Resolved Yufei Gu
          19.
          		 Provide a better out-of-the-box experience for SLS Sub-task Open Unassigned
          20.
          		 SLS is slow while loading 10k queues Sub-task Resolved Yufei Gu
          21.
          		 Rumen input does't work in SLS Sub-task Resolved Yufei Gu
          22.
          		 SLS doesn't honor node total resource specified in sls-runner.xml Sub-task Resolved Wangda Tan
          23.
          		 Add job count in to SLS JSON input format Sub-task Resolved Yufei Gu
          24.
          		 Add elapsed time for SLS metrics Sub-task Open Prabhu Joseph
          25.
          		 Support Generic AM Simulator from SynthGenerator Sub-task Resolved Young Chen
          26.
          		 Refactor SLS Reservation Creation Sub-task Resolved Young Chen
          27.
          		 Support to set container execution type in SLS Sub-task Resolved Jiandan Yang
          28.
          		 Support specifying placement constraint for task containers in SLS Sub-task Patch Available Jiandan Yang
          29.
          		 Support specifying node resources in SLS Sub-task Resolved Abhishek Modi
          30.
          		 Parallelize node addition in SLS Sub-task Resolved Abhishek Modi
          31.
          		 Promoting AMSimulator Sub-task Open Young Chen
          32.
          		 Add chart in SLS to illustrate the throughput of the scheduler Sub-task Resolved Tao Yang
          33.
          		 Add support for Node Labels in SLS Sub-task Resolved Abhishek Modi
          34.
          		 Optimize MockAMLauncher event handling Sub-task Resolved Bibin Chundatt
          35.
          		 Make SLS wrapper class name configurable Sub-task Patch Available Adam Antal
          36.
          		 UI always show default-rack for all the nodes while running SLS. Sub-task Resolved Abhishek Modi
          37.
          		 Add support for allocation id in SLS. Sub-task Resolved Abhishek Modi
          38.
          		 Add support for arbitrary DAG AM Simulator. Sub-task Resolved Abhishek Modi
          39.
          		 SLS runner crashes when run with metrics turned off. Sub-task Resolved Abhishek Modi
          40.
          		 Avoid DNS resolution while running SLS. Sub-task Resolved Abhishek Modi
          41.
          		 General usability improvements in showSimulationTrace.html Sub-task Resolved Adam Antal
          42.
          		 NPE is thrown when accessing SLS web portal Sub-task Open Aihua Xu
          43.
          		 Correct the sample command in SLS README file Sub-task Resolved Aihua Xu

          Activity

            People

              Unassigned Unassigned
              leftnoteasy Wangda Tan
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated: