[STORM-818] storm-eventhubs configuration improvement and refactoring

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.3
• Fix Version/s: 0.10.0
• Component/s: storm-eventhubs
• Assignee: shanyu zhao
• Reporter: shanyu zhao
• Created: 13/May/15 19:40
• Updated: 26/Sep/15 02:19
• Resolved: 03/Jun/15 17:37

Description

In Storm-583 EventHubSpout and EventHubBolt implementation were added. During the review and licensing clearance process, we've improved the code base around the spout/bolt configuration. Specifically, the following changes need to be checked in:

1. EventHubBolt improvement: add event formatter to format tuples into bytes for EventHubs and support each bolt sending to a separate EH partition etc.

2. Refactor EventHubSpoutConfig, use setXXX() instead of specifying configuration in constructor for optional configurations.

3. EventHubSpoutConfig specify consumer group name

4. Workaround for Qpid bug that cannot receive messages from EventHubs in rare cases

5. Upgrade to newer Qpid version 0.32