[FLUME-1238] Support active rolling of files created by HDFS Event Sink

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Assignee: Mike Percy
• Reporter: Arvind Prabhakar
• Created: 30/May/12 09:07
• Updated: 07/Jun/12 01:13
• Resolved: 07/Jun/12 00:28

Description

The HDFS Event Sink uses lazy rolling for closing files that are being written to. This results in many files being open for longer than their expected roll-interval if they are not actively written to and can even last in open state until the sink shuts down.

It will be preferable to have these files roll proactively rather than waiting for a write to trigger the roll.