Uploaded image for project: 'Apache Whirr (retired)'
  1. Apache Whirr (retired)
  2. WHIRR-506

Support elastic mapreduce in whirr

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: cli, core
    • Labels:

      Description

      This is to be an umbrella issue in the path towards having multicloud EMR with whirr.

      Some of the things that must happen towards multicloud EMR (as discussed in IRC):

      • Hadoop deployment must be "rock solid"
      • Submitting and monitoring an hadoop mapreduce job through whirr
      • distcp from blobstore to hadoop/hbase cluster
      • cli component for job submission and monitoring.

      Some of the things that would be nice to have additionally:

      • pig service
      • hive service
      • sqoop service
      • regular+spot instances in EMR
      • multistage provisioning (different cluster sizes for different phases)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                dr-alves David Alves
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: