Hadoop YARN
  1. Hadoop YARN
  2. YARN-349

Send out last-minute load averages in TaskTrackerStatus

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None

      Description

      Load averages could be useful in scheduling. This patch looks to extend the existing Linux resource plugin (via /proc/loadavg file) to allow transmitting load averages of the last one minute via the TaskTrackerStatus.

      Patch is up for review, with test cases added, at: https://reviews.apache.org/r/20/

      1. mapreduce.loadaverage.r6.diff
        11 kB
        Harsh J
      2. mapreduce.loadaverage.r5.diff
        10 kB
        Harsh J
      3. mapreduce.loadaverage.r4.diff
        8 kB
        Harsh J
      4. mapreduce.loadaverage.r3.diff
        8 kB
        Harsh J

        Issue Links

          Activity

          Harsh J created issue -
          Harsh J made changes -
          Field Original Value New Value
          Attachment mapreduce.loadaverage.r3.diff [ 12459720 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Attachment mapreduce.loadaverage.r4.diff [ 12460091 ]
          Harsh J made changes -
          Attachment mapreduce.loadaverage.r5.diff [ 12466938 ]
          Harsh J made changes -
          Status Patch Available [ 10002 ] In Progress [ 3 ]
          Harsh J made changes -
          Status In Progress [ 3 ] Patch Available [ 10002 ]
          Harsh J made changes -
          Priority Minor [ 4 ] Blocker [ 1 ]
          Nigel Daley made changes -
          Fix Version/s 0.22.0 [ 12314184 ]
          Priority Blocker [ 1 ] Critical [ 2 ]
          Harsh J made changes -
          Issue Type Improvement [ 4 ] New Feature [ 2 ]
          Fix Version/s 0.23.0 [ 12315570 ]
          Harsh J made changes -
          Attachment mapreduce.loadaverage.r6.diff [ 12482150 ]
          Harsh J made changes -
          Tags load average, tasktracker, linux load average, tasktracker
          Environment GNU/Linux
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Fix Version/s 0.24.0 [ 12317654 ]
          Fix Version/s 0.23.0 [ 12315570 ]
          Arun C Murthy made changes -
          Priority Critical [ 2 ] Major [ 3 ]
          Harsh J made changes -
          Project Hadoop Map/Reduce [ 12310941 ] Hadoop YARN [ 12313722 ]
          Key MAPREDUCE-2170 YARN-349
          Release Note Add support for transmitting previous-minute load averages in TaskTrackerStatus
          Affects Version/s 2.0.0-alpha [ 12323271 ]
          Affects Version/s 0.22.0 [ 12314184 ]
          Fix Version/s 0.24.0 [ 12317654 ]
          Component/s nodemanager [ 12319323 ]
          Component/s jobtracker [ 12312907 ]
          Tags load average, tasktracker
          Harsh J made changes -
          Comment [ I will return to the office on January 17th. For urgent matters,
          please contact Aparna or Philip L. The week between Christmas and New
          Years', your best bet is Chris L.

          Thanks,

          -- Philip
          ]
          Allen Wittenauer made changes -
          Link This issue duplicates MAPREDUCE-1438 [ MAPREDUCE-1438 ]

            People

            • Assignee:
              Harsh J
              Reporter:
              Harsh J
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 20m
                20m
                Remaining:
                Remaining Estimate - 20m
                20m
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Development