[SAMZA-2334] ProxyGrouper selection based on Host Affinity not whether job is stateful - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.4
Component/s: None
Labels:
None

Description

Changes in partition count of input Kafka topic that is not a multiple of previous topic, causes the grouper to not start up. We should check if the job is a stateful one instead of only checking if the job has host-affinity enabled. Also need to add a configuration to disable the proxy grouper in case the Kafka topic cannot be the multiple of the previous topic and to unblock the job from running.