Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: backlog
    • Fix Version/s: 1.0.0
    • Component/s: deployment
    • Labels:
      None

      Description

      Add support for AmazonLinux to bigtop on the latest AmazonLinux AMI to enable cloud deployments.

        Activity

        Rob Leidle created issue -
        Hide
        jay vyas added a comment -

        Are you talking about packaging or deployment?

        IMO they are different issues.

        1) *Packages* need to be compiled for Amazon Linux. I think that probably you could use base package distros for this. (not sure someone else might weigh in).

        2) *Deployment* would be interesting to add a vagrant EC2 deployer. In that regard, I think Savanna might also benefit if there is a vagrant deployer for savanna.

        Show
        jay vyas added a comment - Are you talking about packaging or deployment? IMO they are different issues. 1) * Packages * need to be compiled for Amazon Linux. I think that probably you could use base package distros for this. (not sure someone else might weigh in). 2) * Deployment * would be interesting to add a vagrant EC2 deployer. In that regard, I think Savanna might also benefit if there is a vagrant deployer for savanna.
        Hide
        Sean Mackrory added a comment -

        I believe they mean #1. Specifically packages that are intended to be deployed on AmazonLinux.

        you could use base package distros

        AmazonLinux's similarity to RHEL 5 and 6 means they will need few, if any, code changes. I wouldn't consider it entirely correct to use the currently-supported RHEL 5 and RHEL 6 packages that Bigtop distributes on AmazonLinux, even though they might work. I suspect this JIRA is to get Bigtop to a state where AmazonLinux can be supported in the same sense as RHEL 6 - where a release is actually accompanied by packages targeted for that system.

        As I type this I'm actually watching Rob setup Jenkins slaves for AmazonLinux

        Show
        Sean Mackrory added a comment - I believe they mean #1. Specifically packages that are intended to be deployed on AmazonLinux. you could use base package distros AmazonLinux's similarity to RHEL 5 and 6 means they will need few, if any, code changes. I wouldn't consider it entirely correct to use the currently-supported RHEL 5 and RHEL 6 packages that Bigtop distributes on AmazonLinux, even though they might work. I suspect this JIRA is to get Bigtop to a state where AmazonLinux can be supported in the same sense as RHEL 6 - where a release is actually accompanied by packages targeted for that system. As I type this I'm actually watching Rob setup Jenkins slaves for AmazonLinux
        Hide
        Andre Arcilla added a comment -

        The intent was to add Amazon Linux to a list of the platforms "supported" by Bigtop (as we vote for in each Bigtop release). The "support" includes IMHO:

        • being able to build Bigtop on
        • having it as a target in puppet recipes/whatever (since Amazon Linux does differ from RHEL5/6 in some packages it provides AFAIK)
        • having Jenkins builds setup for it in addition to other platforms. This includes supporting builds on freshly spun EC2 instances (as opposed to having permanent infrastructure machines as it is the case for regular builds)
        Show
        Andre Arcilla added a comment - The intent was to add Amazon Linux to a list of the platforms "supported" by Bigtop (as we vote for in each Bigtop release). The "support" includes IMHO: being able to build Bigtop on having it as a target in puppet recipes/whatever (since Amazon Linux does differ from RHEL5/6 in some packages it provides AFAIK) having Jenkins builds setup for it in addition to other platforms. This includes supporting builds on freshly spun EC2 instances (as opposed to having permanent infrastructure machines as it is the case for regular builds)
        Hide
        Andrew Purtell added a comment -

        having Jenkins builds setup for it in addition to other platforms

        Sounds like this was just done?

        This includes supporting builds on freshly spun EC2 instances (as opposed to having permanent infrastructure machines as it is the case for regular builds)

        Can you clarify what that means? I build Bigtop packages on/for Amazon Linux AMIs all the time.

        It's also conceivable to script a post release deployment of all BigTop packages preinstalled onto a custom AMI derived from Amazon Linux. For reference, FreeBSD's Colin Percival recently posted his scripts for building FreeBSD AMIs and propagating them to all EC2 regions: http://svnweb.freebsd.org/base/user/cperciva/EC2-build/ .

        Show
        Andrew Purtell added a comment - having Jenkins builds setup for it in addition to other platforms Sounds like this was just done? This includes supporting builds on freshly spun EC2 instances (as opposed to having permanent infrastructure machines as it is the case for regular builds) Can you clarify what that means? I build Bigtop packages on/for Amazon Linux AMIs all the time. It's also conceivable to script a post release deployment of all BigTop packages preinstalled onto a custom AMI derived from Amazon Linux. For reference, FreeBSD's Colin Percival recently posted his scripts for building FreeBSD AMIs and propagating them to all EC2 regions: http://svnweb.freebsd.org/base/user/cperciva/EC2-build/ .
        Hide
        Rob Leidle added a comment -

        We want to add amazon linux as a full blown supported operating system just like debian, centos, etc

        Show
        Rob Leidle added a comment - We want to add amazon linux as a full blown supported operating system just like debian, centos, etc
        Hide
        Ivan Orlov added a comment -

        Add AmazonLinux instructions into toolchain's manifests.

        Show
        Ivan Orlov added a comment - Add AmazonLinux instructions into toolchain's manifests.
        Ivan Orlov made changes -
        Field Original Value New Value
        Attachment 0001-BIGTOP-1204.-Add-toolchain-for-AmazonLinux.patch [ 12682190 ]
        Hide
        Ivan Orlov added a comment -

        AmazonLinux toolchain testing done:

        Build almost all packages of Apache Bigtop on Amazon Linux.

        Problems, wasn't able to build following packages:

        • Pig (misconfiguration of Apache Forrest common for all operation system toolchains)
        • Hue (bigtop-toolchain doesn't contain build dependencies for Hue)
        • Datafu (depends on Pig)
        • Phoenix (depends on Pig)
        Show
        Ivan Orlov added a comment - AmazonLinux toolchain testing done: Build almost all packages of Apache Bigtop on Amazon Linux. Problems, wasn't able to build following packages: Pig (misconfiguration of Apache Forrest common for all operation system toolchains) Hue (bigtop-toolchain doesn't contain build dependencies for Hue) Datafu (depends on Pig) Phoenix (depends on Pig)
        Ivan Orlov made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Roman Shaposhnik added a comment -

        +1 and committed! Thanks a million for the patch!

        Show
        Roman Shaposhnik added a comment - +1 and committed! Thanks a million for the patch!
        Roman Shaposhnik made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Assignee Roman Shaposhnik [ rvs ]
        Fix Version/s 0.9.0 [ 12326836 ]
        Resolution Fixed [ 1 ]
        Konstantin Boudnik made changes -
        Fix Version/s 1.0.0 [ 12326837 ]
        Fix Version/s 0.9.0 [ 12326836 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        287d 4h 46m 1 Ivan Orlov 22/Nov/14 00:03
        Patch Available Patch Available Resolved Resolved
        4d 18h 29m 1 Roman Shaposhnik 26/Nov/14 18:32

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Rob Leidle
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development