Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-529

Code to create the UI display string for queues in the Capacity Scheduler needs to be synchronized, and needs to better update its information

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      There are a couple of problems with SchedulingInfo.toString(), the code which creates the UI display string for a queue:

      • it needs synchronized access to the QueueSchedulingInfo object, as this same object can be updated by the reclaim-capacity thread, and during a heartbeat.
      • the code directly updates its count of running map/reduce tasks. this should be done in a better way, perhaps by calling updateQSIObjects(), rather than walking through the data structures directly. It's also not clear that we want to pay the performance penalty of updating the structures. it maybe OK to provide slightly stale info (the 'staleness' is tiny, in a steady-state and large system, where heartbeats are coming in frequently).

      Attachments

        Activity

          People

            Unassigned Unassigned
            vivekr Vivek Ratan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: