[CHUKWA-589] Functionality allowing collectors to close .chukwa files at a fixed offset inside the rotateInterval

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.5.0
• Fix Version/s: 0.5.0
• Component/s: Data Collection
• Release Note: Allow collectors to close .chukwa files at fixed offset.
• Assignee: Himanshu Gahlot
• Reporter: Himanshu Gahlot
• Created: 13/Jun/11 19:57
• Updated: 23/Jun/11 22:51
• Resolved: 23/Jun/11 22:47

Description

We have a system built on top of Chukwa that introduces the need to have all .chukwa files for a given rotateInterval closed and available at a predictable time. Currently, we are experience some drift in the times that the sequence files are closed due to the way the TimerTask is scheduled in the SeqFileWriter class. We would like to submit a solution that will allow people to configure the time all collectors should close their files for processing in a given interval, while still supporting the default functionality.