Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.6.0
    • Component/s: general
    • Labels:
      None

      Description

      We need to take care of QJM as part of doing this BIGTOP-763. Perhaps it would be ok to be aggressive and start building based on branch-2 now, but we need to figure out what is the likelihood of 2.0.3 actually making it within the next couple of month

      1. 0001-bump-version.patch
        0.8 kB
        Philip Herron
      2. BIGTOP-822.patch.txt
        9 kB
        Roman Shaposhnik
      3. 0001-BIGTOP-822.-Bump-version-of-Hadoop-to-2.0.4.patch
        2 kB
        Roman Shaposhnik

        Issue Links

          Activity

          Roman Shaposhnik made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Roman Shaposhnik made changes -
          Summary Bump version of Hadoop to 2.0.4 Bump version of Hadoop to 2.0.5
          Roman Shaposhnik made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Roman Shaposhnik made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          Hide
          Konstantin Boudnik added a comment -

          I don't think it is a real bad idea to go to trunk with such a change.

          Show
          Konstantin Boudnik added a comment - I don't think it is a real bad idea to go to trunk with such a change.
          Hide
          Konstantin Boudnik added a comment -

          It looks good. Shall we use "official" ASF CI Hadoop build as the source? I can create a job for it.

          +1 overall.

          Show
          Konstantin Boudnik added a comment - It looks good. Shall we use "official" ASF CI Hadoop build as the source? I can create a job for it. +1 overall.
          Roman Shaposhnik made changes -
          Hide
          Roman Shaposhnik added a comment -

          So here's what I propose (although I know it may sound a bit controversial) – given the unique situation with Hadoop 2.0.4-alpha branch I propose we pull it into our trunk now.

          We have to wait for Hadoop 2.0.4-alpha to stabilize and we might as well give everybody a benefit of pulling from the trunk.

          New patch is attached. I'll keep the JIRA open to cut over to the tarball when it gets released.

          P.S. I have also split out the other bits into separate patches for now.

          Show
          Roman Shaposhnik added a comment - So here's what I propose (although I know it may sound a bit controversial) – given the unique situation with Hadoop 2.0.4-alpha branch I propose we pull it into our trunk now. We have to wait for Hadoop 2.0.4-alpha to stabilize and we might as well give everybody a benefit of pulling from the trunk. New patch is attached. I'll keep the JIRA open to cut over to the tarball when it gets released. P.S. I have also split out the other bits into separate patches for now.
          Konstantin Boudnik made changes -
          Link This issue relates to BIGTOP-892 [ BIGTOP-892 ]
          Hide
          Konstantin Boudnik added a comment -

          Don't you need to also install NodeManager on all 3, similar to what you've done for Datanode?

          +  hadoop::nodemanager { "nodemanager":
          +        rm_host => $hadoop_rm_host,
          +        rm_port => $hadoop_rm_port,
          +        rt_port => $hadoop_rt_port,
          +        dirs => $yarn_data_dirs,
          +        auth => $hadoop_security_authentication,
          +  }
          
          Show
          Konstantin Boudnik added a comment - Don't you need to also install NodeManager on all 3, similar to what you've done for Datanode? + hadoop::nodemanager { "nodemanager": + rm_host => $hadoop_rm_host, + rm_port => $hadoop_rm_port, + rt_port => $hadoop_rt_port, + dirs => $yarn_data_dirs, + auth => $hadoop_security_authentication, + }
          Hide
          Peter Linnell added a comment -

          +1 on the patch

          Show
          Peter Linnell added a comment - +1 on the patch
          Roman Shaposhnik made changes -
          Attachment BIGTOP-822.patch.txt [ 12575340 ]
          Roman Shaposhnik made changes -
          Summary Bump version of Hadoop to 2.0.3 Bump version of Hadoop to 2.0.4
          Hide
          Roman Shaposhnik added a comment -

          Unfortunately, we've discovered a few incompatibilities between Hadoop 2.0.3 and the rest of Bigtop components. We are now trying to figure out how to resolve this. Check out the discussions on general@hadoop.a.o

          Show
          Roman Shaposhnik added a comment - Unfortunately, we've discovered a few incompatibilities between Hadoop 2.0.3 and the rest of Bigtop components. We are now trying to figure out how to resolve this. Check out the discussions on general@hadoop.a.o
          Philip Herron made changes -
          Attachment 0001-bump-version.patch [ 12571412 ]
          Philip Herron made changes -
          Field Original Value New Value
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Philip Herron added a comment -

          Looks like i have a patch seems to work for me.

          Show
          Philip Herron added a comment - Looks like i have a patch seems to work for me.
          Roman Shaposhnik created issue -

            People

            • Assignee:
              Roman Shaposhnik
              Reporter:
              Roman Shaposhnik
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development