[CHUKWA-648] Make Chukwa Reduce Type to support hierarchy format

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0, 0.6.0
• Component/s: Data Processors
• Assignee: Jie Huang
• Reporter: Jie Huang
• Created: 16/Jul/12 09:15
• Updated: 05/Aug/12 03:47
• Resolved: 05/Aug/12 02:53

Description

Currently the Reduce Type decides the final directory-structure of the processed data over HDFS. And it doesn't support a hierarchy format like

hdfs/namenode
hdfs/datanode
...

A hierarchy structure makes it easy to do the HDFS File Filter versus to the flat storage structure while doing the analysis job.