Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-beta1, 2.8.3
    • Component/s: build
    • Labels:
      None

      Description

      mvn clean compile -q
      [ERROR] Failed to parse plugin descriptor for org.apache.hadoop:hadoop-maven-plugins:3.0.0-beta1-SNAPSHOT (/Users/abokor/work/hdp/hadoop/hadoop-maven-plugins/target/classes): No plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
      [ERROR]
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR]
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginDescriptorParsingException
      1. HADOOP-14677.01.patch
        0.7 kB
        Andras Bokor
      2. HADOOP-14677.02.patch
        0.7 kB
        Andras Bokor

        Activity

        Hide
        boky01 Andras Bokor added a comment -

        This is because hadoop-maven-plugins generates the descriptor after compile phrase so the classes are compiled during descriptor generation. Since hadoop-common uses the plugin it will fail since descriptor is not yet generated.
        We should generate the descriptor at compile phrase and force maven to run generate after compiler-plugin.
        Attaching trivial patch with the suggested solution.

        Show
        boky01 Andras Bokor added a comment - This is because hadoop-maven-plugins generates the descriptor after compile phrase so the classes are compiled during descriptor generation. Since hadoop-common uses the plugin it will fail since descriptor is not yet generated. We should generate the descriptor at compile phrase and force maven to run generate after compiler-plugin. Attaching trivial patch with the suggested solution.
        Hide
        jojochuang Wei-Chiu Chuang added a comment - - edited

        Thanks for reporting this issue Andras Bokor.
        I applied the patch and still saw the following error (cleared my .m2 cache just in case):

        mvn clean install -DskipTests -Pdist -Dmaven.javadoc.skip=true

        [INFO] ------------------------------------------------------------------------
        [INFO] BUILD FAILURE
        [INFO] ------------------------------------------------------------------------
        [INFO] Total time: 06:53 min
        [INFO] Finished at: 2017-07-22T09:56:42-07:00
        [INFO] Final Memory: 339M/2027M
        [INFO] ------------------------------------------------------------------------
        [ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.4:enforce (enforce-banned-dependencies) on project hadoop-client-check-test-invariants: Some Enforcer rules have failed. Look above for specific messages explaining why the rule failed. -> [Help 1]
        [ERROR]
        [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
        [ERROR] Re-run Maven using the -X switch to enable full debug logging.
        [ERROR]
        [ERROR] For more information about the errors and possible solutions, please read the following articles:
        [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
        [ERROR]
        [ERROR] After correcting the problems, you can resume the build with the command
        [ERROR]   mvn <goals> -rf :hadoop-client-check-test-invariants
        
        Show
        jojochuang Wei-Chiu Chuang added a comment - - edited Thanks for reporting this issue Andras Bokor . I applied the patch and still saw the following error (cleared my .m2 cache just in case): mvn clean install -DskipTests -Pdist -Dmaven.javadoc.skip=true [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 06:53 min [INFO] Finished at: 2017-07-22T09:56:42-07:00 [INFO] Final Memory: 339M/2027M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.4:enforce (enforce-banned-dependencies) on project hadoop-client-check-test-invariants: Some Enforcer rules have failed. Look above for specific messages explaining why the rule failed. -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-client-check-test-invariants
        Hide
        boky01 Andras Bokor added a comment -

        Wei-Chiu Chuang,

        Your failure is a different problem. I checked on Jenkins and the pre-commit builds have been failing for 2 days with the same error. Trunk fails without my patch also.
        It's related to shading. I tried to find out the problem but I do not really know how shading works. Will need help from somebody who knows shading better than me.

        Show
        boky01 Andras Bokor added a comment - Wei-Chiu Chuang , Your failure is a different problem. I checked on Jenkins and the pre-commit builds have been failing for 2 days with the same error. Trunk fails without my patch also. It's related to shading. I tried to find out the problem but I do not really know how shading works. Will need help from somebody who knows shading better than me.
        Hide
        brahmareddy Brahma Reddy Battula added a comment - - edited

        FYI. Wei-Chiu Chuang is error becuase of YARN-6804.Now I reverted that.and I checked this patch,it's working for me.

        Show
        brahmareddy Brahma Reddy Battula added a comment - - edited FYI. Wei-Chiu Chuang is error becuase of YARN-6804 .Now I reverted that.and I checked this patch,it's working for me.
        Hide
        boky01 Andras Bokor added a comment -

        Reattach the same patch to kick Hadoop QA.

        Show
        boky01 Andras Bokor added a comment - Reattach the same patch to kick Hadoop QA .
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 10s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
              trunk Compile Tests
        +1 mvninstall 13m 3s trunk passed
        +1 compile 0m 14s trunk passed
        +1 mvnsite 0m 15s trunk passed
        +1 javadoc 0m 13s trunk passed
              Patch Compile Tests
        +1 mvninstall 0m 12s the patch passed
        +1 compile 0m 11s the patch passed
        +1 javac 0m 11s the patch passed
        +1 mvnsite 0m 11s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 javadoc 0m 9s the patch passed
              Other Tests
        +1 unit 0m 11s hadoop-maven-plugins in the patch passed.
        +1 asflicense 0m 15s The patch does not generate ASF License warnings.
        15m 41s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:14b5c93
        JIRA Issue HADOOP-14677
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12878796/HADOOP-14677.02.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml
        uname Linux 69fe096bd08e 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / ac9489f
        Default Java 1.8.0_131
        Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12853/testReport/
        modules C: hadoop-maven-plugins U: hadoop-maven-plugins
        Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12853/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.       trunk Compile Tests +1 mvninstall 13m 3s trunk passed +1 compile 0m 14s trunk passed +1 mvnsite 0m 15s trunk passed +1 javadoc 0m 13s trunk passed       Patch Compile Tests +1 mvninstall 0m 12s the patch passed +1 compile 0m 11s the patch passed +1 javac 0m 11s the patch passed +1 mvnsite 0m 11s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 javadoc 0m 9s the patch passed       Other Tests +1 unit 0m 11s hadoop-maven-plugins in the patch passed. +1 asflicense 0m 15s The patch does not generate ASF License warnings. 15m 41s Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14677 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12878796/HADOOP-14677.02.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml uname Linux 69fe096bd08e 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / ac9489f Default Java 1.8.0_131 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12853/testReport/ modules C: hadoop-maven-plugins U: hadoop-maven-plugins Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12853/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        boky01 Andras Bokor added a comment -

        No JUnit tests needed, since it is related to build process.

        Show
        boky01 Andras Bokor added a comment - No JUnit tests needed, since it is related to build process.
        Hide
        jojochuang Wei-Chiu Chuang added a comment -

        Thanks Andras Bokor!
        I verified the command mvn clean compile passed after the patch, and mvn clean install passed as well.

        But I am not a Maven Master so can't tell if this is correct after all. So I'll leave my non-binding +1 here.

        Show
        jojochuang Wei-Chiu Chuang added a comment - Thanks Andras Bokor ! I verified the command mvn clean compile passed after the patch, and mvn clean install passed as well. But I am not a Maven Master so can't tell if this is correct after all. So I'll leave my non-binding +1 here.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        +1, thanks a lot for the fix, Andras Bokor. That way we don't have to run "cd hadoop-maven-plugins && mvn install" first as a workaround.

        Show
        ajisakaa Akira Ajisaka added a comment - +1, thanks a lot for the fix, Andras Bokor . That way we don't have to run "cd hadoop-maven-plugins && mvn install" first as a workaround.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12078 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12078/)
        HADOOP-14677. mvn clean compile fails. Contributed by Andras Bokor. (aajisaka: rev 0fd6d0f2d361536b2baf859ddbb082eb2eadcfcf)

        • (edit) hadoop-maven-plugins/pom.xml
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12078 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12078/ ) HADOOP-14677 . mvn clean compile fails. Contributed by Andras Bokor. (aajisaka: rev 0fd6d0f2d361536b2baf859ddbb082eb2eadcfcf) (edit) hadoop-maven-plugins/pom.xml
        Hide
        ajisakaa Akira Ajisaka added a comment -

        Committed this to trunk, branch-2, and branch-2.8. Thanks Andras Bokor again for the great work and thanks Wei-Chiu Chuang for the review.

        Show
        ajisakaa Akira Ajisaka added a comment - Committed this to trunk, branch-2, and branch-2.8. Thanks Andras Bokor again for the great work and thanks Wei-Chiu Chuang for the review.
        Hide
        boky01 Andras Bokor added a comment -

        Thanks Akira Ajisaka!

        Show
        boky01 Andras Bokor added a comment - Thanks Akira Ajisaka !

          People

          • Assignee:
            boky01 Andras Bokor
            Reporter:
            boky01 Andras Bokor
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development