Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.8.0
    • Component/s: general
    • Labels:
      None

      Description

      There's no such thing as Mahout 0.8.1, so bumping to 0.8 only

      1. BIGTOP-1282.patch
        1 kB
        Konstantin Boudnik

        Issue Links

          Activity

          Hide
          cos Konstantin Boudnik added a comment -

          Mahout 0.8 doesn't build with Hadoop 2.x because of misuse of common-math dependency.
          I suggest we move forward with 0.9 version. Objections?

          Show
          cos Konstantin Boudnik added a comment - Mahout 0.8 doesn't build with Hadoop 2.x because of misuse of common-math dependency. I suggest we move forward with 0.9 version. Objections?
          Hide
          cos Konstantin Boudnik added a comment -

          And Mahout 0.9 doesn't build with Hadoop2 either because the expects to use hadoop-core artifact that doesn't exist in hadoop2 at all. I wonder how these guys release their software?

          Show
          cos Konstantin Boudnik added a comment - And Mahout 0.9 doesn't build with Hadoop2 either because the expects to use hadoop-core artifact that doesn't exist in hadoop2 at all. I wonder how these guys release their software?
          Hide
          jayunit100 jay vyas added a comment -

          i say Definetly upgrade with 0.9......... there were a lot of weird things in .8 that got fixed in .9 also iirc.

          Show
          jayunit100 jay vyas added a comment - i say Definetly upgrade with 0.9......... there were a lot of weird things in .8 that got fixed in .9 also iirc.
          Hide
          jayunit100 jay vyas added a comment - - edited

          cos it does build with hadoop 2, you have to specify it though : mvn clean package -Dhadoop2.version=2.2.0

          (actually we do this in bigtop already, sean was just showing me the other day):

          /h~/j~/D~./bigtop/bigtop-packages/src/common/mahout: (remote_master)> cat do-component-build  | grep version
          mvn clean install -Dmahout.skip.distribution=false -DskipTests -Dhadoop.version=$HADOOP_VERSION "$@"
          
          Show
          jayunit100 jay vyas added a comment - - edited cos it does build with hadoop 2, you have to specify it though : mvn clean package -Dhadoop2.version=2.2.0 (actually we do this in bigtop already, sean was just showing me the other day): /h~/j~/D~./bigtop/bigtop-packages/src/common/mahout: (remote_master)> cat do-component-build | grep version mvn clean install -Dmahout.skip.distribution=false -DskipTests -Dhadoop.version=$HADOOP_VERSION "$@"
          Hide
          cos Konstantin Boudnik added a comment - - edited

          OMG.... why not to calculate the version of the platform automatically from the version's value?
          Seriously... dammit.
          Thanks for pointing this out.

          Show
          cos Konstantin Boudnik added a comment - - edited OMG.... why not to calculate the version of the platform automatically from the version's value? Seriously... dammit. Thanks for pointing this out.
          Hide
          jayunit100 jay vyas added a comment -

          i wonder if bigtop should publish a 2x mahout repository for them ? As of now there is know way to get 2x mahout without manually instaling it (i think). i.e. you cant add a remove maven dep for it.

          Show
          jayunit100 jay vyas added a comment - i wonder if bigtop should publish a 2x mahout repository for them ? As of now there is know way to get 2x mahout without manually instaling it (i think). i.e. you cant add a remove maven dep for it.
          Hide
          cos Konstantin Boudnik added a comment -

          This patch provides for successful package to be built.

          Show
          cos Konstantin Boudnik added a comment - This patch provides for successful package to be built.
          Hide
          cos Konstantin Boudnik added a comment -

          i wonder if bigtop should publish a 2x mahout repository for them

          We don't have any repositories on our own, as you know. But once 0.8.0 is published everyone is more than welcome to grab and use the packages. Or you have something different in mind?

          Show
          cos Konstantin Boudnik added a comment - i wonder if bigtop should publish a 2x mahout repository for them We don't have any repositories on our own, as you know. But once 0.8.0 is published everyone is more than welcome to grab and use the packages. Or you have something different in mind?
          Hide
          jayunit100 jay vyas added a comment -

          we don't have repositories of our own

          well.. i see this one http://mvnrepository.com/artifact/org.apache.bigtop.itest ? i assumed someone was publishing maven repos in the shadows

          2) +1 to that patch

          Show
          jayunit100 jay vyas added a comment - we don't have repositories of our own well.. i see this one http://mvnrepository.com/artifact/org.apache.bigtop.itest ? i assumed someone was publishing maven repos in the shadows 2) +1 to that patch
          Hide
          cos Konstantin Boudnik added a comment -

          Well, this isn't "our repository" per se - it's mvncentral We are publishing Bigtop artifacts, yes. That is the artifacts that belong to Bigtop project. Mahout - or others for this matter - aren't ours to provide. That should be a part of their release process much like Hadoop, Hbase and others.

          Committing the patch. Would appreciate the review for others as well.

          Show
          cos Konstantin Boudnik added a comment - Well, this isn't "our repository" per se - it's mvncentral We are publishing Bigtop artifacts, yes. That is the artifacts that belong to Bigtop project. Mahout - or others for this matter - aren't ours to provide. That should be a part of their release process much like Hadoop, Hbase and others. Committing the patch. Would appreciate the review for others as well.
          Hide
          jayunit100 jay vyas added a comment -

          gotcha. re: other reviews... i can look at a couple today if you need me to. also ill play some with BIGTOP-1201 now to review that for you

          Show
          jayunit100 jay vyas added a comment - gotcha. re: other reviews... i can look at a couple today if you need me to. also ill play some with BIGTOP-1201 now to review that for you
          Hide
          cos Konstantin Boudnik added a comment -

          Pushed to master.

          Show
          cos Konstantin Boudnik added a comment - Pushed to master.

            People

            • Assignee:
              cos Konstantin Boudnik
              Reporter:
              cos Konstantin Boudnik
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development