Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-348 Configure Samza jobs through a stream
  3. SAMZA-448

Pass config from JobRunner to JobCoordinator via ConfigStream

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.10.0
    • container
    • None

    Description

      SAMZA-438 modified the AM/local job factories (job coordinator) to pass configuration to SamzaContainer via an HTTP server. This ticket is to modify the other half of the pipeline: the config passing from the JobRunner to the job coordinator to be done via a ConfigStream, rather than an environment variable.

      The goal of this ticket is to make the change as transparent as possible. control-job.sh won't be introduced in this ticket. Instead, we'll continue using the ConfigFactories that we have, but pass the resolved config to the coordinator using the ConfigStream rather than the environment variable.

      Attachments

        1. SAMZA-448-0.patch
          91 kB
          Chris Riccomini
        2. SAMZA-448-1.patch
          94 kB
          Chris Riccomini
        3. SAMZA-448-2.patch
          114 kB
          Chris Riccomini
        4. SAMZA-448-3.patch
          115 kB
          Chris Riccomini
        5. SAMZA-448-4.patch
          123 kB
          Chris Riccomini
        6. SAMZA-448-5.patch
          128 kB
          Chris Riccomini

        Issue Links

          Activity

            People

              criccomini Chris Riccomini
              criccomini Chris Riccomini
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: