Bigtop
  1. Bigtop
  2. BIGTOP-837

Oozie 3.3.0 can't be build against Hadoop 2.0.3 or later

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.6.0
    • Component/s: general
    • Labels:
      None

      Description

      Oozie build is hosed: the versions of Hadoop it builds against are hardcoded in the pom files. It creates unbreakable ties between Oozie and underlying Hadoop even during the build time.

      Even some primitive parametrization would help to workaround this problem, yet it isn't there, which makes 3.3.0 unportable.

      1. BIGTOP-837.patch
        1.0 kB
        Konstantin Boudnik
      2. BIGTOP-837.patch
        1 kB
        Konstantin Boudnik

        Issue Links

          Activity

          Konstantin Boudnik created issue -
          Konstantin Boudnik made changes -
          Field Original Value New Value
          Link This issue relates OOZIE-1201 [ OOZIE-1201 ]
          Konstantin Boudnik made changes -
          Link This issue is blocked by OOZIE-1201 [ OOZIE-1201 ]
          Hide
          Konstantin Boudnik added a comment -

          As per OOZIE-1201 comments, the proposed patch won't fly. So, this would be a blocker for the next release.

          Show
          Konstantin Boudnik added a comment - As per OOZIE-1201 comments, the proposed patch won't fly. So, this would be a blocker for the next release.
          Konstantin Boudnik made changes -
          Priority Critical [ 2 ] Blocker [ 1 ]
          Konstantin Boudnik made changes -
          Link This issue relates OOZIE-1201 [ OOZIE-1201 ]
          Hide
          Konstantin Boudnik added a comment -

          This is an apparently better fix, that will allow - at the very least - do dynamic modification of Oozie's poms

          Show
          Konstantin Boudnik added a comment - This is an apparently better fix, that will allow - at the very least - do dynamic modification of Oozie's poms
          Konstantin Boudnik made changes -
          Attachment BIGTOP-837.patch [ 12567923 ]
          Konstantin Boudnik made changes -
          Assignee Konstantin Boudnik [ cos ]
          Hide
          Roman Shaposhnik added a comment -

          +1. If you could mention OOZIE-1201 in the comments before the sed block that'll be really nice.

          Show
          Roman Shaposhnik added a comment - +1. If you could mention OOZIE-1201 in the comments before the sed block that'll be really nice.
          Hide
          Konstantin Boudnik added a comment -

          I will. Also, I can confirm that stuff works just fine.

          Apparently, there could be more bang for a buck: we can specify the version string to be replaced as a BOM's veriable. Or, better yet, calculate it automatically from Oozie POM's <hadoop.auth.version> variable. But this one is a good start.

          Will upload new patch and commit in the morning.

          Show
          Konstantin Boudnik added a comment - I will. Also, I can confirm that stuff works just fine. Apparently, there could be more bang for a buck: we can specify the version string to be replaced as a BOM's veriable. Or, better yet, calculate it automatically from Oozie POM's <hadoop.auth.version> variable. But this one is a good start. Will upload new patch and commit in the morning.
          Hide
          Konstantin Boudnik added a comment -

          Updated patch with the comment on OOZIE-1201

          Show
          Konstantin Boudnik added a comment - Updated patch with the comment on OOZIE-1201
          Konstantin Boudnik made changes -
          Attachment BIGTOP-837.patch [ 12568076 ]
          Hide
          Roman Shaposhnik added a comment -

          +1 – do commit it!

          Show
          Roman Shaposhnik added a comment - +1 – do commit it!
          Hide
          Konstantin Boudnik added a comment -

          Just committed this.

          I will take a look if the same applies to 0.3.1 and cherry pick it in there if needed.

          Show
          Konstantin Boudnik added a comment - Just committed this. I will take a look if the same applies to 0.3.1 and cherry pick it in there if needed.
          Konstantin Boudnik made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 0.6.0 [ 12323895 ]
          Resolution Fixed [ 1 ]
          Konstantin Boudnik made changes -
          Link This issue is related to BIGTOP-973 [ BIGTOP-973 ]
          Roman Shaposhnik made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          10d 56m 1 Konstantin Boudnik 10/Feb/13 06:01
          Resolved Resolved Closed Closed
          131d 17h 48m 1 Roman Shaposhnik 22/Jun/13 00:49

            People

            • Assignee:
              Konstantin Boudnik
              Reporter:
              Konstantin Boudnik
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development