Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16710

testing_azure.md documentation is misleading

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.2.2
    • Component/s: fs/azure, test
    • Labels:
      None

      Description

      testing_azure.md states that "-Dparallel-tests" will run all the integration tests in parallel.

      But in fact using -Dparallel-tests without any value actually skips the integration tests and runs only the unit tests.

      The reason is that to activate a profile which is able to run ITs in parallel requires parallel-tests property to have a value (abfs, wasb or 'both'). sequential-tests profile defines !parallel-tests as value which means that the property should not even be mentioned.

      Please check the output of help:active-profiles command:

       

      cd hadoop-tools/hadoop-azure
      andrasbokor$ mvn help:active-profiles -Dparallel-tests=abfs 
      - parallel-tests-abfs (source: org.apache.hadoop:hadoop-azure:3.3.0-SNAPSHOT) 
      - os.mac (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT) 
      - hbase1 (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT) 
      andrasbokor$ mvn help:active-profiles -Dparallel-tests
      - os.mac (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)
      - hbase1 (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)
      
      mvn help:active-profiles
      - sequential-tests (source: org.apache.hadoop:hadoop-azure:3.3.0-SNAPSHOT)
      - os.mac (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)
      - hbase1 (source: org.apache.hadoop:hadoop-project:3.3.0-SNAPSHOT)

      The help:active-profiles shows that -Dparallel-tests does not add any IT related profiles and results in skipping all the integration tests during verify phrase.

        Attachments

        1. HADOOP-16710.001.patch
          1 kB
          Andras Bokor

          Activity

            People

            • Assignee:
              boky01 Andras Bokor
              Reporter:
              boky01 Andras Bokor
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: