Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-682

Reserved tasktrackers should be removed when a node is globally blacklisted

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Jobtracker was modified to cleanup reservations created on tasktracker nodes to support high RAM jobs, when the nodes are blacklisted.

      Description

      When support was added to reserve tasktrackers for high RAM jobs per MAPREDUCE-516, we missed removing reservations on tasktrackers that are globally blacklisted. This is not a major concern, just that the reservation might cause the job to finish a little later than if the reservation is removed when the blacklisting happens.

      1. mapreduce-682-ydist.patch
        2 kB
        Sreekanth Ramakrishnan
      2. mapreduce-682-2.patch
        8 kB
        Sreekanth Ramakrishnan
      3. mapreduce-682-1.patch
        4 kB
        Sreekanth Ramakrishnan

        Activity

        Hemanth Yamijala created issue -
        Sreekanth Ramakrishnan made changes -
        Field Original Value New Value
        Attachment mapreduce-682-1.patch [ 12413773 ]
        Sreekanth Ramakrishnan made changes -
        Attachment mapreduce-682-2.patch [ 12413790 ]
        Sreekanth Ramakrishnan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Sreekanth Ramakrishnan [ sreekanth ]
        Hemanth Yamijala made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.21.0 [ 12314045 ]
        Resolution Fixed [ 1 ]
        Sreekanth Ramakrishnan made changes -
        Attachment mapreduce-682-ydist.patch [ 12414313 ]
        Sreekanth Ramakrishnan made changes -
        Release Note Fixes the issue with respect to high ram job reservation not being cleared when the task tracker is black listed.
        Hemanth Yamijala made changes -
        Release Note Fixes the issue with respect to high ram job reservation not being cleared when the task tracker is black listed. Jobtracker was modified to cleanup reservations created on tasktracker nodes to support high RAM jobs, when the nodes are blacklisted.
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Sreekanth Ramakrishnan
            Reporter:
            Hemanth Yamijala
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development