Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-348 Configure Samza jobs through a stream
  3. SAMZA-448

Pass config from JobRunner to JobCoordinator via ConfigStream

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.10.0
    • Component/s: container
    • Labels:
      None

      Description

      SAMZA-438 modified the AM/local job factories (job coordinator) to pass configuration to SamzaContainer via an HTTP server. This ticket is to modify the other half of the pipeline: the config passing from the JobRunner to the job coordinator to be done via a ConfigStream, rather than an environment variable.

      The goal of this ticket is to make the change as transparent as possible. control-job.sh won't be introduced in this ticket. Instead, we'll continue using the ConfigFactories that we have, but pass the resolved config to the coordinator using the ConfigStream rather than the environment variable.

        Attachments

        1. SAMZA-448-5.patch
          128 kB
          Chris Riccomini
        2. SAMZA-448-4.patch
          123 kB
          Chris Riccomini
        3. SAMZA-448-3.patch
          115 kB
          Chris Riccomini
        4. SAMZA-448-2.patch
          114 kB
          Chris Riccomini
        5. SAMZA-448-1.patch
          94 kB
          Chris Riccomini
        6. SAMZA-448-0.patch
          91 kB
          Chris Riccomini

          Issue Links

            Activity

              People

              • Assignee:
                criccomini Chris Riccomini
                Reporter:
                criccomini Chris Riccomini
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: