[STORM-1464] storm-hdfs should support writing to multiple files

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0, 1.1.0
• Component/s: storm-hdfs
• Labels: avro pull-request-available
• Assignee: Aaron Dossett
• Reporter: Aaron Dossett
• Created: 12/Jan/16 14:03
• Updated: 07/Nov/17 17:05
• Resolved: 13/May/16 14:39

Description

Examples of when this is needed include:

• One avro bolt writing multiple schemas, each of which require a different file. Schema evolution is a common use of avro and the avro bolt should support that seamlessly.
• Partitioning output to different directories based on the tuple contents. For example, if the tuple contains a "USER" field, it should be possible to partition based on that value.

Issue Links

• links to: GitHub Pull Request #1044