[HADOOP-15714] tune abfs/wasb parallel the sequential test execution

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: HADOOP-15407
• Component/s: fs/azure
• Assignee: Da Zhou
• Reporter: Steve Loughran
• Created: 03/Sep/18 13:33
• Updated: 23/Sep/18 03:49
• Resolved: 18/Sep/18 11:10

Description

after HADOOP-15664, sequential tests don't run unless you ask for them with the sequential tests profile, as there are now separate profiles for parallel-tests, parallel-tests-abfs and parallel-tests-wasb, so the sequential-tests profile can't just run if !parallel-tests

Proposed: revert back to only having one parallel-tests property, but allow it to take the values "abfs" and "wasb" to explicitly enable on those suites.

This would add the set of options

• -Dparallel-tests : all tests in parallel (== true at runtime)
• -Dparallel-tests=abfs abfs tests only
• -Dparallel-tests=wasb wasb tests only
• "" : nothing defined, sequential

the activations of the profiles would then look at the values in their activation; sequential-tests would be triggered if it was unset.

Issue Links

• is caused by: HADOOP-15664 ABFS: Reduce test run time via parallelization and grouping