Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-25966

Ambari branch-2.7 CI is consistently failing

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.7.8
    • ambari-metrics
    • None

    Description

      Ambari branch-2.7 CI is consistently failing. It fails while building ambari metrics.
      Following build command is failing

      mvn -T 3C install -DskipSurefireTests -DskipPythonTests -Dmaven.test.failure.ignore -DskipTests -Dfindbugs.skip -Drat.skip -Dmaven.artifact.threads=10
      

      Above command fails with following error

      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary:
      [INFO] 
      [INFO] ambari-utility 1.0.0.0-SNAPSHOT .................... SUCCESS [ 15.300 s]
      [INFO] ambari-metrics 2.7.8.0.0 ........................... SUCCESS [  0.268 s]
      [INFO] Ambari Metrics Common 2.7.8.0.0 .................... SUCCESS [ 10.231 s]
      [INFO] Ambari Metrics Hadoop Sink 2.7.8.0.0 ............... SUCCESS [  4.942 s]
      [INFO] Ambari Metrics Flume Sink 2.7.8.0.0 ................ SUCCESS [  4.901 s]
      [INFO] Ambari Metrics Kafka Sink 2.7.8.0.0 ................ SUCCESS [  4.949 s]
      [INFO] Ambari Metrics Storm Sink 2.7.8.0.0 ................ SUCCESS [  5.982 s]
      [INFO] Ambari Metrics Storm Sink (Legacy) 2.7.8.0.0 ....... SUCCESS [  5.943 s]
      [INFO] Ambari Metrics Collector 2.7.8.0.0 ................. FAILURE [ 57.918 s]
      [INFO] Ambari Metrics Monitor 2.7.8.0.0 ................... SUCCESS [  1.842 s]
      [INFO] Ambari Metrics Grafana 2.7.8.0.0 ................... SUCCESS [  7.128 s]
      [INFO] Ambari Metrics Host Aggregator 2.7.8.0.0 ........... SUCCESS [ 20.437 s]
      [INFO] Ambari Metrics Assembly 2.7.8.0.0 .................. SKIPPED
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time:  01:24 min (Wall Clock)
      [INFO] Finished at: 2023-07-12T18:27:23Z
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.apache.maven.plugins:maven-dependency-plugin:3.6.0:copy-dependencies (default) on project ambari-metrics-timelineservice: Excluding every artifact inside 'test' resolution scope means excluding everything: you probably want includeScope='compile', read parameters documentation for detailed explanations -> [Help 1]
      [ERROR] 
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR] 
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
      [ERROR] 
      [ERROR] After correcting the problems, you can resume the build with the command
      [ERROR]   mvn <args> -rf :ambari-metrics-timelineservice
      

      Attachments

        Issue Links

          Activity

            I tried executing same build command locally, it is passing.
            Any idea what else we can check on this?
            Anybody who have CI write access, can you please run CI with debug enabled.

            arshad.mohammad Mohammad Arshad added a comment - I tried executing same build command locally, it is passing. Any idea what else we can check on this? Anybody who have CI write access, can you please run CI with debug enabled.
            arshad.mohammad Mohammad Arshad added a comment - - edited

            Thanks brahmareddy for enabling the debug log.
            In my local code changed maven-dependency-plugin version to 3.6.0 then metrics build started failing with the same error as CI error.
            In CI environment some how 3.6.0 maven-dependency-plugin version is used. Restricted the version to 2.8, as this is version used by other modules, to solve this problem. Raised PR.

            arshad.mohammad Mohammad Arshad added a comment - - edited Thanks brahmareddy for enabling the debug log. In my local code changed maven-dependency-plugin version to 3.6.0 then metrics build started failing with the same error as CI error. In CI environment some how 3.6.0 maven-dependency-plugin version is used. Restricted the version to 2.8, as this is version used by other modules, to solve this problem. Raised PR.

            I analysed bit more, branch-2.7 CI is using maven 3.9.3. When I build branch-2.7 ambari metrics with maven 3.9.3, build is failing with same error as CI. So this maven version is making the difference.

            Same behaviour is there with Ambari metrics master code as well. If ambari metrics master repository is built with maven 3.9.3, build is failing with same error as error in CI. This indicates that metrics master branch CI must not be running with 3.9.3 maven version that is why master branch CI is running without failure.

            arshad.mohammad Mohammad Arshad added a comment - I analysed bit more, branch-2.7 CI is using maven 3.9.3. When I build branch-2.7 ambari metrics with maven 3.9.3, build is failing with same error as CI. So this maven version is making the difference. Same behaviour is there with Ambari metrics master code as well. If ambari metrics master repository is built with maven 3.9.3, build is failing with same error as error in CI. This indicates that metrics master branch CI must not be running with 3.9.3 maven version that is why master branch CI is running without failure.

            Nice Catch. +1, Committed to branch-2.7.  thanks arshad.mohammad  for your contribution.

            It's maven incompatibility between 3.9.3 and 3.9.2 .

            brahmareddy Brahma Reddy Battula added a comment - Nice Catch. +1, Committed to branch-2.7.  thanks arshad.mohammad   for your contribution. It's maven incompatibility between 3.9.3 and 3.9.2 .

            maven-dependency-plugin is used in many other modules, but in all the modules either version is mentioned or <excludeScope> is not present. That is why build is not failing in other modules.

            Only ambari-metrics-timelineservice module have not configured version, also it has <excludeScope> config. So change is required only in ambari-metrics-timelineservice module.

            arshad.mohammad Mohammad Arshad added a comment - maven-dependency-plugin is used in many other modules, but in all the modules either version is mentioned or <excludeScope> is not present. That is why build is not failing in other modules. Only ambari-metrics-timelineservice module have not configured version, also it has <excludeScope> config. So change is required only in ambari-metrics-timelineservice module.

            Thanks brahmareddy for reviewing and committing the PR

            arshad.mohammad Mohammad Arshad added a comment - Thanks brahmareddy for reviewing and committing the PR

            People

              arshad.mohammad Mohammad Arshad
              arshad.mohammad Mohammad Arshad
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m