[HADOOP-16710] testing_azure.md documentation is misleading

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.2
• Component/s: fs/azure, test
• Assignee: Andras Bokor
• Reporter: Andras Bokor
• Created: 14/Nov/19 14:56
• Updated: 17/Nov/19 17:20
• Resolved: 17/Nov/19 17:06

Description

testing_azure.md states that "-Dparallel-tests" will run all the integration tests in parallel.

But in fact using -Dparallel-tests without any value actually skips the integration tests and runs only the unit tests.

The reason is that to activate a profile which is able to run ITs in parallel requires parallel-tests property to have a value (abfs, wasb or 'both'). sequential-tests profile defines !parallel-tests as value which means that the property should not even be mentioned.

Please check the output of help:active-profiles command:

 

cd hadoop-tools/hadoop-azure
andrasbokor$ mvn help:active-profiles -Dparallel-tests=abfs 
- parallel-tests-abfs (source: org.apache.hadoop:hadoop-azure:3.3.0-SNAPSHOT) 
- os.mac (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT) 
- hbase1 (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT) 

andrasbokor$ mvn help:active-profiles -Dparallel-tests
- os.mac (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)
- hbase1 (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)

mvn help:active-profiles
- sequential-tests (source: org.apache.hadoop:hadoop-azure:3.3.0-SNAPSHOT)
- os.mac (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)
- hbase1 (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)

The help:active-profiles shows that -Dparallel-tests does not add any IT related profiles and results in skipping all the integration tests during verify phrase.