Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: new service
    • Labels:
      None

      Description

      From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

      1. WHIRR-121.patch
        55 kB
        Tom White
      2. WHIRR-121.patch
        17 kB
        Tom White
      3. WHIRR-121.patch
        17 kB
        Tom White

        Activity

        Hide
        Dharmesh Kakadia added a comment -

        Tom White Thanks for the quick reply. I will explore this.

        Show
        Dharmesh Kakadia added a comment - Tom White Thanks for the quick reply. I will explore this.
        Hide
        Tom White added a comment -

        Dharmesh - I'm not currently working on this, so feel free to take it on if you're interested.

        Show
        Tom White added a comment - Dharmesh - I'm not currently working on this, so feel free to take it on if you're interested.
        Hide
        Dharmesh Kakadia added a comment -

        I am interested in running mesos with whirr. May I know the current status of this ?

        Show
        Dharmesh Kakadia added a comment - I am interested in running mesos with whirr. May I know the current status of this ?
        Hide
        Tom White added a comment -

        Here's a new version which I tried out. To build:

        mvn clean install
        cp cli/target/whirr-cli-*-SNAPSHOT.jar .
        

        I used the following configuration:

        whirr.service-name=mesos
        whirr.cluster-name=mymesoscluster
        whirr.instance-templates=1 mesos-master,1 mesos-slave
        whirr.provider=ec2
        whirr.identity=...
        whirr.credential=...
        whirr.client-cidrs=0.0.0.0/0
        whirr.run-url-base=http://whirr.s3.amazonaws.com/WHIRR-mesos/
        

        Run with

        bin/whirr launch-cluster --config=mesos.properties
        

        It takes a while (20 mins or more) to start since the install script has to build Mesos from source. This could be improved if Mesos built RPMs, or if we had WHIRR-88. Using larger instances would help a lot too.

        Multiple services are being tracked in WHIRR-117 - Mesos + HDFS is a great example of where we want to get to.

        Show
        Tom White added a comment - Here's a new version which I tried out. To build: mvn clean install cp cli/target/whirr-cli-*-SNAPSHOT.jar . I used the following configuration: whirr.service-name=mesos whirr.cluster-name=mymesoscluster whirr.instance-templates=1 mesos-master,1 mesos-slave whirr.provider=ec2 whirr.identity=... whirr.credential=... whirr.client-cidrs=0.0.0.0/0 whirr.run-url-base=http://whirr.s3.amazonaws.com/WHIRR-mesos/ Run with bin/whirr launch-cluster --config=mesos.properties It takes a while (20 mins or more) to start since the install script has to build Mesos from source. This could be improved if Mesos built RPMs, or if we had WHIRR-88 . Using larger instances would help a lot too. Multiple services are being tracked in WHIRR-117 - Mesos + HDFS is a great example of where we want to get to.
        Hide
        Matei Zaharia added a comment -

        Pretty cool to see this posted. How should I test it out? Also, is it possible to launch multiple services on the same cluster yet (e.g. Mesos + HDFS)?

        Show
        Matei Zaharia added a comment - Pretty cool to see this posted. How should I test it out? Also, is it possible to launch multiple services on the same cluster yet (e.g. Mesos + HDFS)?
        Hide
        Tom White added a comment -

        Updated patch now that WHIRR-87 is in.

        Show
        Tom White added a comment - Updated patch now that WHIRR-87 is in.
        Hide
        Tom White added a comment -

        Work-in-progress patch. Includes WHIRR-87.

        Show
        Tom White added a comment - Work-in-progress patch. Includes WHIRR-87 .

          People

          • Assignee:
            Unassigned
            Reporter:
            Tom White
          • Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:

              Development