[HADOOP-4433] Improve data loader for collecting metrics and log files from hadoop and system

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.19.0

Environment

Red Hat Enterprise Linux 4.5, 5, Java 6

• Hadoop Flags: Reviewed

Release Note

- Added startup and shutdown script
- Added torque metrics data loader
- Improve handling of Exec Plugin
- Added Test cases for File Tailing Adaptors
- Added Test cases for Start streaming at specific offset

• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 16/Oct/08 21:29
• Updated: 02/May/13 02:29
• Resolved: 31/Oct/08 18:57

Description

Enhancement should include:

• Ability to stream /var/log/messages
• Better handling of startup and shutdown chukwa processes
• Ability to monitor torque/hod allocated clusters
• Add serialization and deserialization of hadoop metrics to JSON log files.

Issue Links

• depends upon: HADOOP-4431 Add versionning/tags to Chukwa Chunk
• is depended upon by: HADOOP-4459 - Improve Chukwa Collector