[SAMZA-1434] Fix issues found in Hadoop

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 0.14.0
• Assignee: Xinyu Liu
• Reporter: Xinyu Liu
• Created: 29/Sep/17 18:41
• Updated: 21/Nov/17 19:31
• Resolved: 21/Nov/17 19:31

Description

Fix the following bugs found when running Samza on hadoop:

• Hdfs allows output partitions to be 0 (empty folder)
• Add null check for the changelog topic generation
• Call getStreamSpec() instead of using streamSpec member in StreamEdge. This is due to getStreamSpec will do more transformation.
• Bound the auto-generated intermediate topic partition by a certain count (256).

Issue Links

• links to: GitHub Pull Request #307