[MAPREDUCE-1461] Feature to instruct rumen-folder utility to skip jobs worth of specific duration

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.0
• Component/s: tools/rumen
• Hadoop Flags: Reviewed

Release Note

Added a ''-starts-after' option to Rumen's Folder utility. The time duration specified after the '-starts-after' option is an offset with respect to the submit time of the first job in the input trace. Jobs in the input trace having a submit time (relative to the first job's submit time) lesser than the specified offset will be ignored.

• Tags: rumen, folder, skip-jobs
• Assignee: Rajesh Balamohan
• Reporter: Rajesh Balamohan
• Created: 05/Feb/10 05:53
• Updated: 15/Nov/11 00:49
• Resolved: 28/Apr/11 04:26

Description

JSON outputs of rumen on production logs can be huge in the order of multiple GB. Rumen's folder utility helps in getting a smaller snapshot of this JSON data.
It would be helpful to have an option in rumen-folder, wherein user can specify a duration from which rumen-folder should start processing data.

Related JIRA link: https://issues.apache.org/jira/browse/MAPREDUCE-1295