Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
0.20.1
-
None
-
None
Description
blacklisted_maps and blacklisted_reduces metrics collected displays wrong values. For example when trackers_blacklisted=6 and with each TT having 6 map slots and 2 reduce slots, blacklisted_maps should be 36 and blacklisted_reduces should be 12. However I observed values which were not expected. Below is a snapshot of the metrics obtained:
mapred.jobtracker: hostName=<hostname>, sessionId=, blacklisted_maps=24, blacklisted_reduces=8, jobs_completed=136, jobs_failed=26, jobs_killed=0, jobs_preparing=0, jobs_running=13, jobs_submitted=165, map_slots=2748, maps_completed=76501, maps_failed=8741, maps_killed=0, maps_launched=88199, occupied_map_slots=1902, occupied_reduce_slots=902, reduce_slots=916, reduces_completed=21927, reduces_failed=184, reduces_killed=0, reduces_launched=23027, reserved_map_slots=0, reserved_reduce_slots=0, running_maps=1902, running_reduces=902, trackers=464, trackers_blacklisted=6, trackers_decommissioned=1, waiting_maps=-1741, waiting_reduces=2042