Uploaded image for project: 'Hama'
  1. Hama
  2. HAMA-567

BSPPeer should provide means for chaining supersteps to share data among them.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.6.0
    • None
    • bsp core
    • None

    Description

      In most scenarios, a superstep would need certain values or objects that were computed in the previous superstep. When using the chaining Superstep design to implement BSP algorithms, this gets a little ugly/difficult to implement. BSPPeer should provide means (preferably a map<String,Object>) so that the next Superstep can ask for the values in previous superstep using String token to query the map. Also, this map could be checkpointed periodically in the background so that we can completely recover the state of a task after failure. The BSPPeer object should have a dedicated get and set function for updating values in the peer.

      Attachments

        1. Mapper.java
          4 kB
          Suraj Menon

        Issue Links

          Activity

            People

              Unassigned Unassigned
              surajsmenon Suraj Menon
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated: