Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Later
    • Affects Version/s: 0.23.0
    • Fix Version/s: None
    • Component/s: mrv2
    • Labels:
      None
    • Environment:

      All Unix-Environments

      Description

      MPI is commonly used for many machine-learning applications. OpenMPI (http://www.open-mpi.org/) is a popular BSD-licensed version of MPI. In the past, running MPI application on a Hadoop cluster was achieved using Hadoop Streaming (http://videolectures.net/nipsworkshops2010_ye_gbd/), but it was kludgy. After the resource-manager separation from JobTracker in Hadoop, we have all the tools needed to make MPI a first-class citizen on a Hadoop cluster. I am currently working on the patch to make MPI an application-master. Initial version of this patch will be available soon (hopefully before September 10.) This jira will track the development of Hamster: The application master for MPI.

        Activity

        Hars Vardhan made changes -
        Assignee Ralph H Castain [ rcastain ]
        Hars Vardhan made changes -
        Assignee Ralph van Etten [ ralph ] Ralph H Castain [ rcastain ]
        Hars Vardhan made changes -
        Assignee Ralph Castain [ rhc ] Ralph van Etten [ ralph ]
        Hars Vardhan made changes -
        Assignee Hars Vardhan [ hars.vardhan ] Ralph Castain [ rhc ]
        Hars Vardhan made changes -
        Assignee Hars Vardhan [ hars.vardhan ]
        Ralph Castain made changes -
        Assignee Ralph H Castain [ rcastain ]
        Arun C Murthy made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Fix Version/s 0.24.0 [ 12317654 ]
        Resolution Later [ 7 ]
        Arun C Murthy made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Milind Bhandarkar made changes -
        Status In Progress [ 3 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Milind Bhandarkar made changes -
        Assignee Milind Bhandarkar [ milindb ] Ralph H Castain [ rcastain ]
        Arun C Murthy made changes -
        Fix Version/s 0.24.0 [ 12317654 ]
        Fix Version/s 0.23.0 [ 12315570 ]
        Milind Bhandarkar made changes -
        Field Original Value New Value
        Status Open [ 1 ] In Progress [ 3 ]
        Milind Bhandarkar created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Milind Bhandarkar
          • Votes:
            6 Vote for this issue
            Watchers:
            78 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 336h
              336h
              Remaining:
              Remaining Estimate - 336h
              336h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development