[HADOOP-4711] Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed

Environment

Redhat EL 4.5, Java 1.6, Hadoop trunk

• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 21/Nov/08 22:37
• Updated: 08/Jul/09 16:40
• Resolved: 11/Dec/08 02:57

Description

In chukwa agent, we added ability to rotate collector on each HTTP post. RAD Lab is using Chukwa Agent differently, and would like to have the option to keep agent on the same collector. On the smaller scale of the Chukwa, it makes sense to process data without the map reduce job. A new interface needs to be created as a T pipe line to stream data from collector directly into a Database or external storage. In this configuration, it is better to channel similar data to the same collector to reduce the cost of reassembling chunks.

Issue Links

• is duplicated by: HADOOP-4805 Remove black list feature from Chukwa Agent to Chukwa Collector communication