Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4797

LocalContainerAllocator can loop forever trying to contact the RM

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.1-alpha
    • Fix Version/s: 2.0.3-alpha, 0.23.5
    • Component/s: applicationmaster
    • Labels:
      None

      Description

      If LocalContainerAllocator has trouble communicating with the RM it can end up retrying forever if the nature of the error is not a YarnException.

      This can be particulary bad if the connection went down because the cluster was reset such that the RM and NM have lost track of the process and therefore nothing else will eventually kill the process. In this scenario, the looping AM continues to pelt the RM with connection requests every second using a stale token, and the RM logs the SASL exceptions over and over.

      1. MAPREDUCE-4797.patch
        6 kB
        Jason Lowe
      2. MAPREDUCE-4797.patch
        6 kB
        Jason Lowe

        Activity

        Jason Lowe created issue -
        Jason Lowe made changes -
        Field Original Value New Value
        Assignee Jason Lowe [ jlowe ]
        Jason Lowe made changes -
        Attachment MAPREDUCE-4797.patch [ 12553564 ]
        Jason Lowe made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 2.0.3-alpha, 0.23.5 [ 12323275, 12323312 ]
        Jason Lowe made changes -
        Attachment MAPREDUCE-4797.patch [ 12553572 ]
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Fix Version/s 2.0.3-alpha [ 12323275 ]
        Fix Version/s 0.23.5 [ 12323312 ]
        Resolution Fixed [ 1 ]
        Thomas Graves made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12320355 ]

          People

          • Assignee:
            Jason Lowe
            Reporter:
            Jason Lowe
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development