Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 1.0.0
    • Component/s: hbase
    • Labels:
      None

      Description

      hbase does not compile any more

      [WARNING] /home/olaf/bigtop/output/hbase/hbase-0.98.5/hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java:149: warning - Tag @link: reference not found: org.apache.hadoop.hbase.ipc.RpcServerEngine
      [INFO] Generating "User API" report    --- maven-javadoc-plugin:2.9.1
      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary:
      [INFO] 
      [INFO] HBase ............................................. FAILURE [5:15.805s]
      [INFO] HBase - Common .................................... SKIPPED
      [INFO] HBase - Protocol .................................. SKIPPED
      [INFO] HBase - Client .................................... SKIPPED
      [INFO] HBase - Hadoop Compatibility ...................... SKIPPED
      [INFO] HBase - Hadoop Two Compatibility .................. SKIPPED
      [INFO] HBase - Prefix Tree ............................... SKIPPED
      [INFO] HBase - Server .................................... SKIPPED
      [INFO] HBase - Testing Util .............................. SKIPPED
      [INFO] HBase - Thrift .................................... SKIPPED
      [INFO] HBase - Shell ..................................... SKIPPED
      [INFO] HBase - Integration Tests ......................... SKIPPED
      [INFO] HBase - Examples .................................. SKIPPED
      [INFO] HBase - Assembly .................................. SKIPPED
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 5:17.105s
      [INFO] Finished at: Sun Mar 08 16:11:23 CET 2015
      [INFO] Final Memory: 80M/852M
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.3:site (default-site) on project hbase: Error during page generation: Error rendering Maven report: Unable to resolve artifact:groupId = 'org.apache.hadoop'
      [ERROR] artifactId = 'hadoop-common'
      [ERROR] version = '2.6.0': Missing:
      [ERROR] ----------
      [ERROR] 1) org.apache.directory.jdbm:apacheds-jdbm1:bundle:2.0.0-M2
      [ERROR] 
      [ERROR] Try downloading the file manually from the project website.
      [ERROR] 
      [ERROR] Then, install it using the command:
      [ERROR] mvn install:install-file -DgroupId=org.apache.directory.jdbm -DartifactId=apacheds-jdbm1 -Dversion=2.0.0-M2 -Dpackaging=bundle -Dfile=/path/to/file
      [ERROR] 
      [ERROR] Alternatively, if you host your own repository you can deploy the file there:
      [ERROR] mvn deploy:deploy-file -DgroupId=org.apache.directory.jdbm -DartifactId=apacheds-jdbm1 -Dversion=2.0.0-M2 -Dpackaging=bundle -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
      [ERROR] 
      [ERROR] Path to dependency:
      [ERROR] 1) org.apache.hadoop:hadoop-common:jar:2.6.0
      [ERROR] 2) org.apache.hadoop:hadoop-minikdc:jar:2.6.0
      [ERROR] 3) org.apache.directory.server:apacheds-jdbm-partition:jar:2.0.0-M15
      [ERROR] 4) org.apache.directory.jdbm:apacheds-jdbm1:bundle:2.0.0-M2
      [ERROR] 
      [ERROR] ----------
      [ERROR] 1 required artifact is missing.
      [ERROR] 
      [ERROR] for artifact:
      [ERROR] org.apache.hadoop:hadoop-common:jar:2.6.0
      [ERROR] 
      [ERROR] from the specified remote repositories:
      [ERROR] apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots, releases=true, snapshots=true),
      [ERROR] repository.jboss.org (http://repository.jboss.org/nexus/content/groups/public/, releases=true, snapshots=false),
      [ERROR] central (http://repo.maven.apache.org/maven2, releases=true, snapshots=false),
      [ERROR] apache release (https://repository.apache.org/content/repositories/releases/, releases=true, snapshots=true),
      [ERROR] java.net (http://download.java.net/maven/2/, releases=true, snapshots=false),
      [ERROR] codehaus (http://repository.codehaus.org/, releases=true, snapshots=false),
      [ERROR] ghelmling.testing (http://people.apache.org/~garyh/mvn/, releases=true, snapshots=true),
      [ERROR] apache.snapshots (http://repository.apache.org/snapshots, releases=false, snapshots=true)
      [ERROR] -> [Help 1]
      [ERROR] 
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR] 
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
      debian/rules:34: recipe for target 'override_dh_auto_build' failed
      make[1]: *** [override_dh_auto_build] Error 1
      make[1]: Leaving directory '/home/olaf/bigtop/output/hbase/hbase-0.98.5'
      debian/rules:31: recipe for target 'build' failed
      make: *** [build] Error 2
      dpkg-buildpackage: Fehler: Fehler-Exitstatus von debian/rules build war 2
      debuild: fatal error at line 1376:
      

        Activity

        Hide
        oflebbe Olaf Flebbe added a comment -

        The dependency hell seems to open like this:

        hadoop-minikdc-2.6.0.pom :

         <dependency>
              <groupId>org.apache.directory.server</groupId>
              <artifactId>apacheds-jdbm-partition</artifactId>
              <version>2.0.0-M15</version>
              <scope>compile</scope>
              <exclusions>
                <exclusion>
                  <groupId>org.apache.directory.api</groupId>
                  <artifactId>api-ldap-schema-data</artifactId>
                </exclusion>
              </exclusions>
            </dependency>
        

        apacheds-jdbm-partition-2.0.0-M15.pom

         <parent>
            <groupId>org.apache.directory.server</groupId>
            <artifactId>apacheds-parent</artifactId>
            <version>2.0.0-M15</version>
          </parent>
        

        apacheds-parent-2.0.0-M15.pom

        ....
        <org.apache.directory.jdbm.version>2.0.0-M2</org.apache.directory.jdbm.version>
        ....
            <dependency>
                <groupId>org.apache.directory.jdbm</groupId>
                <artifactId>apacheds-jdbm1</artifactId>
                <type>bundle</type>
                <version>${org.apache.directory.jdbm.version}</version>
              </dependency>
         

        Don't know why this fails.. and why now ...

        Show
        oflebbe Olaf Flebbe added a comment - The dependency hell seems to open like this: hadoop-minikdc-2.6.0.pom : <dependency> <groupId>org.apache.directory.server</groupId> <artifactId>apacheds-jdbm-partition</artifactId> <version>2.0.0-M15</version> <scope>compile</scope> <exclusions> <exclusion> <groupId>org.apache.directory.api</groupId> <artifactId>api-ldap-schema-data</artifactId> </exclusion> </exclusions> </dependency> apacheds-jdbm-partition-2.0.0-M15.pom <parent> <groupId>org.apache.directory.server</groupId> <artifactId>apacheds-parent</artifactId> <version>2.0.0-M15</version> </parent> apacheds-parent-2.0.0-M15.pom .... <org.apache.directory.jdbm.version>2.0.0-M2</org.apache.directory.jdbm.version> .... <dependency> <groupId>org.apache.directory.jdbm</groupId> <artifactId>apacheds-jdbm1</artifactId> <type>bundle</type> <version>${org.apache.directory.jdbm.version}</version> </dependency> Don't know why this fails.. and why now ...
        Hide
        oflebbe Olaf Flebbe added a comment -

        And btw: It fails on centos too...

        Show
        oflebbe Olaf Flebbe added a comment - And btw: It fails on centos too...
        Hide
        oflebbe Olaf Flebbe added a comment -

        Seems like the most simple fix is to update hbase

        Show
        oflebbe Olaf Flebbe added a comment - Seems like the most simple fix is to update hbase
        Hide
        oflebbe Olaf Flebbe added a comment -

        Update to hbase-0.98.10.1 fixes bigtop build problem.

        Show
        oflebbe Olaf Flebbe added a comment - Update to hbase-0.98.10.1 fixes bigtop build problem.
        Hide
        oflebbe Olaf Flebbe added a comment -

        cleaned up installation of init scripts for deb

        Show
        oflebbe Olaf Flebbe added a comment - cleaned up installation of init scripts for deb
        Hide
        cos Konstantin Boudnik added a comment -

        looks good +1 (assumed it has been tested)

        Show
        cos Konstantin Boudnik added a comment - looks good +1 (assumed it has been tested)
        Hide
        warwithin YoungWoo Kim added a comment -

        Let me take a look at it.

        Show
        warwithin YoungWoo Kim added a comment - Let me take a look at it.
        Hide
        warwithin YoungWoo Kim added a comment -

        Olaf Flebbe, Thanks for the patch! Overall LGTM and packaging artifacts works fine on my end, but

        $ rpm -qpl output/hbase/noarch/hbase-0.98.10.1-1.fc20.noarch.rpm | grep tests.jar
        /usr/lib/hbase/hbase-common-0.98.10.1-hadoop2-tests.jar
        /usr/lib/hbase/hbase-it-0.98.10.1-hadoop2-tests.jar
        /usr/lib/hbase/hbase-server-0.98.10.1-hadoop2-tests.jar
        /usr/lib/hbase/lib/hbase-common-0.98.10.1-hadoop2-tests.jar
        /usr/lib/hbase/lib/hbase-it-0.98.10.1-hadoop2-tests.jar
        /usr/lib/hbase/lib/hbase-server-0.98.10.1-hadoop2-tests.jar
        

        Is that Intentional? otherwise, should be removed.

        Show
        warwithin YoungWoo Kim added a comment - Olaf Flebbe , Thanks for the patch! Overall LGTM and packaging artifacts works fine on my end, but $ rpm -qpl output/hbase/noarch/hbase-0.98.10.1-1.fc20.noarch.rpm | grep tests.jar /usr/lib/hbase/hbase-common-0.98.10.1-hadoop2-tests.jar /usr/lib/hbase/hbase-it-0.98.10.1-hadoop2-tests.jar /usr/lib/hbase/hbase-server-0.98.10.1-hadoop2-tests.jar /usr/lib/hbase/lib/hbase-common-0.98.10.1-hadoop2-tests.jar /usr/lib/hbase/lib/hbase-it-0.98.10.1-hadoop2-tests.jar /usr/lib/hbase/lib/hbase-server-0.98.10.1-hadoop2-tests.jar Is that Intentional? otherwise, should be removed.
        Hide
        cos Konstantin Boudnik added a comment -

        Ah, good catch: I don't remember if we use HBase test artifacts in Bigtop integration tests or for any other purpose. Andrew Purtell - could you please chime in, if we need these?

        Show
        cos Konstantin Boudnik added a comment - Ah, good catch: I don't remember if we use HBase test artifacts in Bigtop integration tests or for any other purpose. Andrew Purtell - could you please chime in, if we need these?
        Hide
        apurtell Andrew Purtell added a comment -

        The HBase test classes are needed for HBase smokes, but I don't see where -tests jars need to be in lib/ for them.

        Downstream projects or users won't be able to stand up miniclusters without hbase-server-*tests. Would that be an issue? Depends what users want I suppose. Could put them in an hbase-dev package if we were separating out -dev pieces in Bigtop generally (but we are not (yet)).

        Show
        apurtell Andrew Purtell added a comment - The HBase test classes are needed for HBase smokes, but I don't see where -tests jars need to be in lib/ for them. Downstream projects or users won't be able to stand up miniclusters without hbase-server-*tests. Would that be an issue? Depends what users want I suppose. Could put them in an hbase-dev package if we were separating out -dev pieces in Bigtop generally (but we are not (yet)).
        Hide
        warwithin YoungWoo Kim added a comment -

        Thanks for your clarification Andrew Purtell. I believe, it is good to go.

        Show
        warwithin YoungWoo Kim added a comment - Thanks for your clarification Andrew Purtell . I believe, it is good to go.
        Hide
        warwithin YoungWoo Kim added a comment -

        Committed and pushed. Thanks!

        Show
        warwithin YoungWoo Kim added a comment - Committed and pushed. Thanks!
        Hide
        oflebbe Olaf Flebbe added a comment -

        Thanks!

        Show
        oflebbe Olaf Flebbe added a comment - Thanks!

          People

          • Assignee:
            oflebbe Olaf Flebbe
            Reporter:
            oflebbe Olaf Flebbe
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development