[CHUKWA-430] Narrow down input for FSM mapreduce job

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.0
• Component/s: MR Data Processors
• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 14/Dec/09 15:44
• Updated: 16/Dec/09 15:50
• Resolved: 16/Dec/09 02:50

Description

FSMDataloader supplies all demux output data to FSM state machine. This is not efficient because most of the data type do not contribute to state generation. According to Jiaqi, the state machine requires the following types:

JobHistoryTaskDataMapper:

/chukwa/repos/chukwa/JobData
/chukwa/repos/chukwa/TaskData

TaskTrackerClientTraceMapper:

/chukwa/repos/chukwa/ClientTraceDetailed

DataNodeClientTraceMapper:

/chukwa/repos/chukwa/ClientTraceDetailed

This jira is to optimize the data loader supplied input, and narrow down the required input type.