Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3050

YarnScheduler needs to expose Resource Usage Information

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 2.0.0-alpha
    • Fix Version/s: 0.23.0
    • Component/s: mrv2, resourcemanager
    • Labels:
      None

      Description

      Before the recent refactor The nodes had information in them about how much resources they were using. This information is not hidden inside SchedulerNode. Similarly resource usage information about an application, or in aggregate is only available through the Scheduler and there is not interface to pull it out.

      We need to expose APIs to get Resource and Container information from the scheduler, in aggregate across the entire cluster, per application, per node, and ideally also per queue if applicable (although there are no JIRAs I am aware of that need this right now).

        Attachments

        1. MR-3050.txt
          25 kB
          Robert Joseph Evans
        2. MR-3050.txt
          26 kB
          Robert Joseph Evans
        3. MR-3050.txt
          27 kB
          Robert Joseph Evans
        4. MR-3050.txt
          91 kB
          Robert Joseph Evans
        5. MR-3050.txt
          91 kB
          Robert Joseph Evans
        6. MR-3050.txt
          91 kB
          Robert Joseph Evans
        7. MR-3050.txt
          90 kB
          Robert Joseph Evans

          Issue Links

            Activity

              People

              • Assignee:
                revans2 Robert Joseph Evans
                Reporter:
                revans2 Robert Joseph Evans
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: