[CHUKWA-504] Implement ability to delete file in FileAdaptor after successfully uploaded

• Type: New Feature
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.4.0
• Component/s: Data Collection
• Assignee: Ariel Shemaiah Rabkin
• Reporter: Kirk True
• Created: 28/Jul/10 21:55
• Updated: 30/Jul/10 17:47

Description

My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.

Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.

Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.