[YARN-6522] Make SLS JSON input file format simple and scalable

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha2
• Fix Version/s: 3.0.0-alpha4
• Component/s: scheduler-load-simulator
• Hadoop Flags: Reviewed
• Assignee: Yufei Gu
• Reporter: Yufei Gu
• Created: 24/Apr/17 18:51
• Updated: 19/Jul/19 09:15
• Resolved: 05/May/17 00:22

Description

SLS input format is verbose, and it doesn't scale out. We can improve it in these ways:

1. We need to configure tasks one by one if there are more than one task in a job, which means the job configuration usually includes lots of redundant items. To specify the number of task for task configuration will solve this issue.
2. Container host is useful for locality testing. It is obnoxious to specify container host for each task for tests unrelated to locality. We would like to make it optional.
3. For most tests, we don't care about job.id. Make it optional and generated automatically by default.
4. job.finish.ms doesn't make sense, just remove it.
5. container type and container priority should be optional as well.