[SAMZA-689] When Kafka has topic auto-creation turned on, checkpoint topics may be created w/ wrong partition numbers

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.9.1
• Component/s: container
• Assignee: Unassigned
• Reporter: Yi Pan
• Created: 26/May/15 18:52
• Updated: 19/Feb/16 17:15
• Resolved: 19/Feb/16 17:15

Description

When Kafka topic auto-creation is turned on in the brokers, a fetch metadata API call will result in topic auto-creation w/ default number of partitions.

In Samza code, we should always try to create the checkpoint/changelog topic w/ the expected number of partitions first, then call fetch metadata to avoid topic auto-creation creating the topic w/ un-wanted number of partitions.