[YARN-10547] Decouple job parsing logic from SLSRunner

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: scheduler-load-simulator
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Szilard Nemeth
• Reporter: Szilard Nemeth
• Created: 26/Dec/20 13:51
• Updated: 11/Feb/24 10:31
• Resolved: 24/Mar/22 05:18

Description

SLSRunner has too many responsibilities.
One of them is to parse the job details from the SLS input formats and launch the AMs and task containers.
As a first step, the job parser logic could be decoupled from this class.

There are 3 types of inputs:

• SLS trace
• Synth
• Rumen

Their job parsing method are:

• SLS trace: https://github.com/apache/hadoop/blob/005b854f6bad66defafae0abf95dabc6c36ca8b1/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/SLSRunner.java#L479-L526
• Synth: https://github.com/apache/hadoop/blob/005b854f6bad66defafae0abf95dabc6c36ca8b1/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/SLSRunner.java#L722-L790
• Rumen: https://github.com/apache/hadoop/blob/005b854f6bad66defafae0abf95dabc6c36ca8b1/hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/SLSRunner.java#L651-L716

Issue Links

• Dependency: YARN-10548 Decouple AM runner logic from SLSRunner
• Dependency: YARN-10549 Decouple RM runner logic from SLSRunner
• Dependency: YARN-10550 Decouple NM runner logic from SLSRunner
• is related to: YARN-11094 Follow up changes for YARN-10547