• Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Implemented
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.5.0
    • Labels:


      Use case:

      • at startup or during runtime, s4 nodes are notified of new applications available. The code for these applications is fetched from a remote repository, installed on S4 nodes, and the applications are started automatically.

      How does it work?

      • Zookeeper is used for coordination: when a new app is available, it creates a new znode under /s4-cluster-name/apps/app1
      • S4 nodes are notified of this new znode, which contains the s4r URI as metadata
      • S4 nodes can then fetch the s4r, copy it to a local directory and start it
      • we also need a facility to create the app into Zookeeper, along with required metadata

      For a first milestone, I suggest:

      • a simple file system based repository (can be a distributed file system)
      • deployment only, no unloading

      Later we can add extensions:

      • We could provide various repository clients, depending on the protocol specified, and on the level of trust of the repository (although for a first version, we would just provide a simple mechanism and assume a trustworthy environment).
      • more metada in the application znode, in order to control the state of the app, a time to start / stop, a number of nodes, nodes requirements etc...

      I'll start working on a first implementation, and I'm eager to receive suggestions.

      1. S4-24.patch
        135 kB
        Matthieu Morel

        Issue Links


          Matthieu Morel created issue -
          Matthieu Morel made changes -
          Field Original Value New Value
          Parent S4-10 [ 12526968 ]
          Issue Type New Feature [ 2 ] Sub-task [ 7 ]
          Matthieu Morel made changes -
          Assignee Matthieu Morel [ mmorel ]
          Leo Neumeyer made changes -
          Link This issue relates to S4-4 [ S4-4 ]
          Matthieu Morel made changes -
          Link This issue depends on S4-4 [ S4-4 ]
          Matthieu Morel made changes -
          Attachment S4-24.patch [ 12509569 ]
          Matthieu Morel made changes -
          Link This issue is related to S4-77 [ S4-77 ]
          Matthieu Morel made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Implemented [ 10 ]
          Tony Stevenson made changes -
          Workflow jira [ 12641865 ] no-reopen-closed, patch-avail [ 12711371 ]
          Gavin made changes -
          Link This issue depends on S4-4 [ S4-4 ]
          Gavin made changes -
          Link This issue depends upon S4-4 [ S4-4 ]


            • Assignee:
              Matthieu Morel
              Matthieu Morel
            • Votes:
              0 Vote for this issue
              1 Start watching this issue


              • Created: