Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-603

Expose more consumer controls to developers

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.9.0
    • None
    • container
    • None

    Description

      Several overlapping feature requests have emerged. People want the ability to programmatically:

      1. Add new input streams after a job has started.
      2. Pause consuming a stream for a period of time.
      3. Stop consuming a stream.
      4. Override offsets at both job start time, and after a job has been running for a while (rewind/fast forward).

      We don't really expose any of these controls to the StreamTask or JobCoordinator in a pluggable way. This is an umbrella ticket to track this work.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SAMZA-568 Start offset override in Task init

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Wish - General wishlist item. SAMZA-255 Rewinding Streams within a StreamTask

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Task - A task that needs to be done. SAMZA-570 Poll for new Kafka input topics when using wildcards

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              criccomini Chris Riccomini
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: