Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1381

Incorrect values being displayed for blacklisted_maps and blacklisted_reduces

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 0.20.1
    • None
    • jobtracker
    • None

    Description

      blacklisted_maps and blacklisted_reduces metrics collected displays wrong values. For example when trackers_blacklisted=6 and with each TT having 6 map slots and 2 reduce slots, blacklisted_maps should be 36 and blacklisted_reduces should be 12. However I observed values which were not expected. Below is a snapshot of the metrics obtained:

      mapred.jobtracker: hostName=<hostname>, sessionId=, blacklisted_maps=24, blacklisted_reduces=8, jobs_completed=136, jobs_failed=26, jobs_killed=0, jobs_preparing=0, jobs_running=13, jobs_submitted=165, map_slots=2748, maps_completed=76501, maps_failed=8741, maps_killed=0, maps_launched=88199, occupied_map_slots=1902, occupied_reduce_slots=902, reduce_slots=916, reduces_completed=21927, reduces_failed=184, reduces_killed=0, reduces_launched=23027, reserved_map_slots=0, reserved_reduce_slots=0, running_maps=1902, running_reduces=902, trackers=464, trackers_blacklisted=6, trackers_decommissioned=1, waiting_maps=-1741, waiting_reduces=2042

      Attachments

        Activity

          People

            Unassigned Unassigned
            rramya Ramya Sunil
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: