Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1415

Add clearStream API in SystemAdmin

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • None
    • None

    Description

      For use cases like batch processing, samza need to re-process from beginning for each run. This also requires the ability to reset internal metadata streams so the processors will not accidentally read the meta data from previous runs, e.g. checkpoints. In order to support this use case, we need a new API in SystemAdmin to clear streams.

      For Kafka, clearStream will delete the topic in the brokers. This requires the following config for the brokers:

      delete.topic.enable=true

      Attachments

        Issue Links

          Activity

            People

              xinyu Xinyu Liu
              xinyu Xinyu Liu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: