[FLUME-1118] Improve HDFS flush corrdination with channel trasaction handling

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.1.0, 1.2.0
• Component/s: Sinks+Sources
• Assignee: Prasad Suresh Mujumdar
• Reporter: Prasad Suresh Mujumdar
• Created: 10/Apr/12 17:57
• Updated: 10/Apr/12 17:57

Description

Currently there are a few cases like batch flush and file roll where the data can be flushed to HDFS before the channel transaction is committed. If the transaction is rolled back due later we would end up duplicates.
We need address the corner cases in HDFS flushing.