Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.8.2, 0.9.0
    • Component/s: service/hadoop
    • Labels:
      None

      Description

      Whirr is still using hadoop-0.20.205, though the current stable version is 1.0.3. This can be changed trivially in the pom and whirr-hadoop-default.properties. It may have implications in the deployments, hence the "major" marking.

      1. whirr-661-3.diff
        8 kB
        Steve Loughran
      2. whirr-661-2.diff
        105 kB
        Steve Loughran
      3. whirr-661.diff
        2 kB
        Steve Loughran

        Issue Links

          Activity

          Hide
          Andrei Savu added a comment -

          + we also need to update the integration tests: hopefully only the maven dependencies.

          Show
          Andrei Savu added a comment - + we also need to update the integration tests: hopefully only the maven dependencies.
          Hide
          Steve Loughran added a comment -

          This tweaks the base pom and whirr-hadoop-default.properties; there's no other instance of 0.20.205 for the IDE to find.

          All the tests need rerunning, there may be some hadoop-site options worth tuning.

          Show
          Steve Loughran added a comment - This tweaks the base pom and whirr-hadoop-default.properties ; there's no other instance of 0.20.205 for the IDE to find. All the tests need rerunning, there may be some hadoop-site options worth tuning.
          Hide
          Steve Loughran added a comment -

          some refs to 0.20.2 surface in recipe property files too

          Show
          Steve Loughran added a comment - some refs to 0.20.2 surface in recipe property files too
          Hide
          Steve Loughran added a comment -

          go through the .pom and .properties files and sync up with 1.0.3 across them all -where appropriate.

          Show
          Steve Loughran added a comment - go through the .pom and .properties files and sync up with 1.0.3 across them all -where appropriate.
          Hide
          Steve Loughran added a comment -

          This patch comes from a search of "0.20.2" across the entire codebase

          Show
          Steve Loughran added a comment - This patch comes from a search of "0.20.2" across the entire codebase
          Hide
          Andrew Bayer added a comment -

          So this patch actually seems to be adding an hdp service as well as changing the Hadoop version - was that intentional?

          Show
          Andrew Bayer added a comment - So this patch actually seems to be adding an hdp service as well as changing the Hadoop version - was that intentional?
          Hide
          Steve Loughran added a comment -

          no the HDP injection is separate, I'll split that back out until I'm happy with it. (it's not dependent on this 1.0.3 patch)

          Show
          Steve Loughran added a comment - no the HDP injection is separate, I'll split that back out until I'm happy with it. (it's not dependent on this 1.0.3 patch)
          Hide
          Steve Loughran added a comment -

          patch of correct branch

          Show
          Steve Loughran added a comment - patch of correct branch
          Hide
          Andrew Bayer added a comment -

          Late but +1 - I'll commit it in the next day or two.

          Show
          Andrew Bayer added a comment - Late but +1 - I'll commit it in the next day or two.
          Hide
          Andrew Bayer added a comment -

          Committed.

          Show
          Andrew Bayer added a comment - Committed.
          Hide
          Andrew Bayer added a comment -

          Pushed to branch-0.8

          Show
          Andrew Bayer added a comment - Pushed to branch-0.8

            People

            • Assignee:
              Andrew Bayer
              Reporter:
              Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development