Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
This should include
– the commands (mapper and reducer commands) executed
– time information (e.g. min, max, and avg start time, end time, elapsed time for tasks, total elapsed time )
– sizes – bytes and records, min, max, avg per task and total, input and output
– information about input and output data sets (all output data sets, if there are several)
– all user counters (when they are implemented for streaming)
the information should be stored in a file – e.g. in the working directory from where the job was launched, with a name derived from the job name