[CHUKWA-533] Improve fault-tolerance of collectors.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: Data Collection
• Release Note: Chukwa collector is more fault-tolerant of partial HDFS outages.
• Assignee: William W. Graham Jr
• Reporter: William W. Graham Jr
• Created: 12/Oct/10 17:51
• Updated: 24/Nov/10 17:49
• Resolved: 24/Nov/10 17:49

Description

There are currently a number of ways that a collector can die, typically due to errors on a DN or a NN that's being restarted. A collector should have some combination of retry logic followed by failing back to the agent, but the collector process should not die.