Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
      None

      Description

      Some of the pom definitions are broken for the Hadoop 2.0 build. Its breaking the build for that version

      1. hbase-6112-revert-and-docs.patch
        8 kB
        Jesse Yates
      2. hbase-6112-v0.patch
        2 kB
        Jesse Yates

        Activity

        Hide
        Jesse Yates added a comment -

        This is my bad - docs for the different builds are out of date and didn't port quite as expected. Patch coming soon

        Show
        Jesse Yates added a comment - This is my bad - docs for the different builds are out of date and didn't port quite as expected. Patch coming soon
        Hide
        Jesse Yates added a comment -

        Attaching patch for Hadoop profile fixes. Now, you just need to specify the which hadoop version on the command line, via:

        -Dhadoop.version=X
        

        For example, if you wanted to use hadoop 2.0.0-alpha, you would specify:

        -Dhadoop.version=2.0.0-alpha
        

        The default is still to run against hadoop-1.0.3

        Show
        Jesse Yates added a comment - Attaching patch for Hadoop profile fixes. Now, you just need to specify the which hadoop version on the command line, via: -Dhadoop.version=X For example, if you wanted to use hadoop 2.0.0-alpha, you would specify: -Dhadoop.version=2.0.0-alpha The default is still to run against hadoop-1.0.3
        Hide
        Ted Yu added a comment - - edited

        I tried using '-Dhadoop.profile=2.0' on commandline and tests were launched normally.

        Patch integrated to trunk.

        New build launched:
        https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-2.0.0/23/console

        Thanks Jesse.

        Show
        Ted Yu added a comment - - edited I tried using '-Dhadoop.profile=2.0' on commandline and tests were launched normally. Patch integrated to trunk. New build launched: https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-2.0.0/23/console Thanks Jesse.
        Hide
        Jesse Yates added a comment -

        Unfortunately, I think that doesn't actually activate any of the profiles, so it defaults to the hadoop 1.0 profile. You can check by adding

        help:active-profiles
        

        to the command to see what the active profiles are, which in this case I think should be hadoop-1.0.

        The right way should be to use -Dhadoop.version=2.0.0-alpha or -P hadoop-2.0

        Show
        Jesse Yates added a comment - Unfortunately, I think that doesn't actually activate any of the profiles, so it defaults to the hadoop 1.0 profile. You can check by adding help:active-profiles to the command to see what the active profiles are, which in this case I think should be hadoop-1.0. The right way should be to use -Dhadoop.version=2.0.0-alpha or -P hadoop-2.0
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #23 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/23/)
        HBASE-6112 Fix hadoop-2.0 build (Jesse Yates) (Revision 1343071)

        Result = FAILURE
        tedyu :
        Files :

        • /hbase/trunk/hbase-server/pom.xml
        • /hbase/trunk/pom.xml
        Show
        Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #23 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/23/ ) HBASE-6112 Fix hadoop-2.0 build (Jesse Yates) (Revision 1343071) Result = FAILURE tedyu : Files : /hbase/trunk/hbase-server/pom.xml /hbase/trunk/pom.xml
        Hide
        Jesse Yates added a comment -

        this is just test failures from hbase-6110 and not having the correct command for the hadoop version.

        Show
        Jesse Yates added a comment - this is just test failures from hbase-6110 and not having the correct command for the hadoop version.
        Hide
        Ted Yu added a comment -

        We got the following when specifying '-P hadoop-2.0':

        [ERROR] Failed to execute goal on project hbase-server: Could not resolve dependencies for project org.apache.hbase:hbase-server:jar:0.95-SNAPSHOT: Could not find artifact org.apache.hadoop:hadoop-annotations:jar:1.0.3 in apache release (https://repository.apache.org/content/repositories/releases/) -> [Help 1]
        
        Show
        Ted Yu added a comment - We got the following when specifying '-P hadoop-2.0': [ERROR] Failed to execute goal on project hbase-server: Could not resolve dependencies for project org.apache.hbase:hbase-server:jar:0.95-SNAPSHOT: Could not find artifact org.apache.hadoop:hadoop-annotations:jar:1.0.3 in apache release (https: //repository.apache.org/content/repositories/releases/) -> [Help 1]
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK #2933 (See https://builds.apache.org/job/HBase-TRUNK/2933/)
        HBASE-6112 Fix hadoop-2.0 build (Jesse Yates) (Revision 1343071)

        Result = FAILURE
        tedyu :
        Files :

        • /hbase/trunk/hbase-server/pom.xml
        • /hbase/trunk/pom.xml
        Show
        Hudson added a comment - Integrated in HBase-TRUNK #2933 (See https://builds.apache.org/job/HBase-TRUNK/2933/ ) HBASE-6112 Fix hadoop-2.0 build (Jesse Yates) (Revision 1343071) Result = FAILURE tedyu : Files : /hbase/trunk/hbase-server/pom.xml /hbase/trunk/pom.xml
        Hide
        Jesse Yates added a comment -

        @Ted:
        Hmm, don't know why this wasn't working before. Looks like the correct way to specify a hadoop profile can only be "-Dhadoop.profile=X". Lets revert this patch and then update jenkins. I'll also update the docs.

        Side note - also, still seems to be using the -P skipITs, which no longer applies.

        Show
        Jesse Yates added a comment - @Ted: Hmm, don't know why this wasn't working before. Looks like the correct way to specify a hadoop profile can only be "-Dhadoop.profile=X". Lets revert this patch and then update jenkins. I'll also update the docs. Side note - also, still seems to be using the -P skipITs, which no longer applies.
        Hide
        Jesse Yates added a comment -

        I guess the only question is do we want 2.0.0-SNAPSHOT OR 2.0.0-alpha?

        Show
        Jesse Yates added a comment - I guess the only question is do we want 2.0.0-SNAPSHOT OR 2.0.0-alpha?
        Hide
        Ted Yu added a comment -

        The build #26 showed much fewer failed tests:
        https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-2.0.0/26/console

        I don't think we need to rollback this change.

        I added 'help:active-profiles' to build #27

        I would vote for 2.0.0-alpha because it should give us better stability.

        Show
        Ted Yu added a comment - The build #26 showed much fewer failed tests: https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-2.0.0/26/console I don't think we need to rollback this change. I added 'help:active-profiles' to build #27 I would vote for 2.0.0-alpha because it should give us better stability.
        Hide
        Jesse Yates added a comment -

        The way it's now, with the patch applied, is having to -Dhadoop.version=2.0, which mixes the actual properties with the profile activated. Minor change, but that breaks how we were officially doing things before (with -Phadoop.profile=X).

        Show
        Jesse Yates added a comment - The way it's now, with the patch applied, is having to -Dhadoop.version=2.0, which mixes the actual properties with the profile activated. Minor change, but that breaks how we were officially doing things before (with -Phadoop.profile=X).
        Hide
        Jesse Yates added a comment -

        revert this change to the original standard of -Dhadoop.profile. Also, updating the docs around maven.

        Show
        Jesse Yates added a comment - revert this change to the original standard of -Dhadoop.profile. Also, updating the docs around maven.
        Hide
        Jesse Yates added a comment -

        aside: the hadoop 2.0 build command should go from:

        /home/hudson/tools/maven/latest3/bin/mvn -PrunAllTests clean -Dmaven.test.redirectTestOutputToFile=true install assembly:single -DskipITs -Prelease -Dhadoop.version=2.0.0-alpha
        

        to this:

        /home/hudson/tools/maven/latest3/bin/mvn -PrunAllTests clean -Dmaven.test.redirectTestOutputToFile=true help:active-profiles install assembly:single -Prelease -Dhadoop.profile=2.0
        

        which should work. Sorry about being a bit frantic on these patches - trying to get the codebase working as fast as possible.

        Show
        Jesse Yates added a comment - aside: the hadoop 2.0 build command should go from: /home/hudson/tools/maven/latest3/bin/mvn -PrunAllTests clean -Dmaven.test.redirectTestOutputToFile= true install assembly:single -DskipITs -Prelease -Dhadoop.version=2.0.0-alpha to this: /home/hudson/tools/maven/latest3/bin/mvn -PrunAllTests clean -Dmaven.test.redirectTestOutputToFile= true help:active-profiles install assembly:single -Prelease -Dhadoop.profile=2.0 which should work. Sorry about being a bit frantic on these patches - trying to get the codebase working as fast as possible.
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #29 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/29/)
        HBASE-6112 Fix hadoop-2.0 build, revert first patch and amend docs (Jesse) (Revision 1343120)

        Result = FAILURE
        tedyu :
        Files :

        • /hbase/trunk/hbase-server/pom.xml
        • /hbase/trunk/hbase-site/src/docbkx/developer.xml
        • /hbase/trunk/pom.xml
        Show
        Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #29 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/29/ ) HBASE-6112 Fix hadoop-2.0 build, revert first patch and amend docs (Jesse) (Revision 1343120) Result = FAILURE tedyu : Files : /hbase/trunk/hbase-server/pom.xml /hbase/trunk/hbase-site/src/docbkx/developer.xml /hbase/trunk/pom.xml
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK #2937 (See https://builds.apache.org/job/HBase-TRUNK/2937/)
        HBASE-6112 Fix hadoop-2.0 build, revert first patch and amend docs (Jesse) (Revision 1343120)

        Result = FAILURE
        tedyu :
        Files :

        • /hbase/trunk/hbase-server/pom.xml
        • /hbase/trunk/hbase-site/src/docbkx/developer.xml
        • /hbase/trunk/pom.xml
        Show
        Hudson added a comment - Integrated in HBase-TRUNK #2937 (See https://builds.apache.org/job/HBase-TRUNK/2937/ ) HBASE-6112 Fix hadoop-2.0 build, revert first patch and amend docs (Jesse) (Revision 1343120) Result = FAILURE tedyu : Files : /hbase/trunk/hbase-server/pom.xml /hbase/trunk/hbase-site/src/docbkx/developer.xml /hbase/trunk/pom.xml
        Hide
        stack added a comment -

        Marking closed.

        Show
        stack added a comment - Marking closed.

          People

          • Assignee:
            Jesse Yates
            Reporter:
            Jesse Yates
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development