Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-2477

JobModel isn't updated with latest "task.inputs" if enabled regex topic rewriter

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.5
    • None
    • None

    Description

      JobModelManager provides readJobModel() function to let JobCoordinator, ClusterBasedJboCoordinator and etc notice the latest JobModel information.

      If the users enable regex topic rewriter in their config, readJobModel() function will dynamically load the latest Kafka topic list and generate new TaskModel with new topic partition mappings.

      However, it doesn't update the `task.inputs` in JobModel's Config. So other services depend on `task.inputs` information will still see stale data.

      Attachments

        Issue Links

          Activity

            People

              alnzng Alan Zhang
              alnzng Alan Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m