[CHUKWA-313] Remove the 10 sec ack from SeqWriter

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.2.0, 0.3.0
• Fix Version/s: 0.2.0, 0.3.0
• Assignee: Jerome Boulon
• Reporter: Jerome Boulon
• Created: 18/Jun/09 21:36
• Updated: 23/Jun/09 15:41
• Resolved: 19/Jun/09 01:57

Description

SeqWriter.add is waiting 10 sec in a worse case before calling a flush. This was there to guarantee that the data has been written to HDFS before returning the ack.
It used to work well with 0.18 but in 0.20 the flush is a nohup so there's no point in waiting 10 sec for nothing.

The real flush will give us the ability to write redo logs directly to HDFS so the ack implementation will have to change anyway.
So I vote for removing the 10 sec ack from the add method.

Issue Links

• incorporates: CHUKWA-303 collector gets stuck when unable to write to hdfs