CloudStack
  1. CloudStack
  2. CLOUDSTACK-1782

GSoC: Improve CloudStack support in apache whirr and incubator-provisioner to created hadoop clusters

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Future
    • Component/s: None
    • Security Level: Public (Anyone can view this level - this is the default.)
    • Labels:

      Description

      A IaaS is used to create virtual clusters, with the interest in big data it is crucial to automate the provisioning of hadoop clusters using IaaS solutions. This project will bring together several apache projects (Top Level and in incubation) to improve CloudStack support in apache Whirr and Provisionr in order to enable provisioning of Hadoop clusters on CloudStack based clouds.

      Language: Java, Python
      Knowledge: Hadoop

        Activity

        sebastien goasguen created issue -
        Hide
        Lok Kei Leong added a comment -

        Hi,
        I am new to GSoc and I am interested working on Hadoop and big data. Can someone give me more detail on this project?
        Thanks,

        Show
        Lok Kei Leong added a comment - Hi, I am new to GSoc and I am interested working on Hadoop and big data. Can someone give me more detail on this project? Thanks,
        Hide
        adama Coulibaly added a comment -

        I am interested on this project. Can i have more details about this project?
        Best,

        Show
        adama Coulibaly added a comment - I am interested on this project. Can i have more details about this project? Best,
        Hide
        sebastien goasguen added a comment -

        There is a slide deck available here: http://buildacloud.org/blog/254-google-summer-of-code-2013-with-cloudstack.html

        Apache Whirr and apache Provisionr are two projects that aim to do "one-click" Hadoop clusters on top of Clouds. They have limited support for CloudStack based clouds.

        This project will be about making sure that Whirr and Provisionr can make use of CloudStack to deploy Hadoop clusters. You will need to understand how to do configuration management and deploy all the required VMs for a hadoop cluster. In addition the project can look at how to implement a similar functionality to the AWS Elastic Map Reduce.

        Write a proposal and submit your applications to the Google Summer of Code.

        Register on the Cloudstack mailing list if you are interested: dev-subscribe@cloudstack.apache.org

        and read:

        https://cwiki.apache.org/confluence/display/CLOUDSTACK/Student+Projects

        Show
        sebastien goasguen added a comment - There is a slide deck available here: http://buildacloud.org/blog/254-google-summer-of-code-2013-with-cloudstack.html Apache Whirr and apache Provisionr are two projects that aim to do "one-click" Hadoop clusters on top of Clouds. They have limited support for CloudStack based clouds. This project will be about making sure that Whirr and Provisionr can make use of CloudStack to deploy Hadoop clusters. You will need to understand how to do configuration management and deploy all the required VMs for a hadoop cluster. In addition the project can look at how to implement a similar functionality to the AWS Elastic Map Reduce. Write a proposal and submit your applications to the Google Summer of Code. Register on the Cloudstack mailing list if you are interested: dev-subscribe@cloudstack.apache.org and read: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Student+Projects
        sebastien goasguen made changes -
        Field Original Value New Value
        Fix Version/s Future [ 12323850 ]
        Fix Version/s 4.2.0 [ 12323906 ]
        menghan made changes -
        Assignee menghan [ kyrameng ]
        Hide
        sebastien goasguen added a comment -

        provisioner was dropped, and whirr works.

        Show
        sebastien goasguen added a comment - provisioner was dropped, and whirr works.
        sebastien goasguen made changes -
        Resolution Fixed [ 1 ]
        Status Open [ 1 ] Closed [ 6 ]

          People

          • Assignee:
            menghan
            Reporter:
            sebastien goasguen
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development