Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1415

Add clearStream API in SystemAdmin

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      For use cases like batch processing, samza need to re-process from beginning for each run. This also requires the ability to reset internal metadata streams so the processors will not accidentally read the meta data from previous runs, e.g. checkpoints. In order to support this use case, we need a new API in SystemAdmin to clear streams.

      For Kafka, clearStream will delete the topic in the brokers. This requires the following config for the brokers:

      delete.topic.enable=true

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                xinyu Xinyu Liu
                Reporter:
                xinyu Xinyu Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: