Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-1929

Add code to cleanly stop a running streaming topology

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9
    • None
    • None
    • None

    Description

      Right now its not possible to cleanly stop a running Streaming topology.

      Cancelling the job will cancel all operators, but for proper exactly once processing from Kafka sources, we need to provide a way to stop the sources first, wait until all remaining tuples have been processed and then shut down the sources (so that they can commit the right offset to Zookeeper).

      Attachments

        Issue Links

          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-2111 Add "stop" signal to cleanly shutdown streaming jobs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              Unassigned Unassigned
              rmetzger Robert Metzger
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: