Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-2334

ProxyGrouper selection based on Host Affinity not whether job is stateful

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4
    • Component/s: None
    • Labels:
      None

      Description

      Changes in partition count of input Kafka topic that is not a multiple of previous topic, causes the grouper to not start up. We should check if the job is a stateful one instead of only checking if the job has host-affinity enabled. Also need to add a configuration to disable the proxy grouper in case the Kafka topic cannot be the multiple of the previous topic and to unblock the job from running.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dnishimura Daniel Nishimura
                Reporter:
                dnishimura Daniel Nishimura
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 40m
                  2h 40m