[FLUME-1104] HDFS rolls the first file incorrectly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.2.0
• Component/s: Sinks+Sources
• Assignee: Prasad Suresh Mujumdar
• Reporter: Prasad Suresh Mujumdar
• Created: 06/Apr/12 00:39
• Updated: 06/Apr/12 04:25
• Resolved: 06/Apr/12 03:47

Description

The sink process() keep tracks of the buckets opened during the transaction. At the end of transaction, we need to flush all the buckets that has pending data. This is required in order to ensure that the data removed from channel should be safely in HDFS during commit.
Currently the files are tracked only when they are created and also getting closed during the cleanup instead of flush.