Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None

      Description

      MAPREDUCE-2652 allows ShuffleHandler to return the port it is operating on. In the case of an ApplicationMaster crash where it needs to be restarted that information is lost. We either need to re-query it from each of the NodeManagers or to persist it to the JobHistory logs and retrieve it again. The job history logs is probably the simpler solution.

      1. MAPREDUCE-2666.patch
        13 kB
        Jonathan Eagles
      2. MAPREDUCE-2666.patch
        8 kB
        Jonathan Eagles

        Activity

        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Target Version/s 0.24.0, 0.23.0 [ 12317654, 12315570 ] 0.23.0 [ 12315570 ]
        Resolution Fixed [ 1 ]
        Jonathan Eagles made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 0.24.0, 0.23.0 [ 12317654, 12315570 ] 0.23.0, 0.24.0 [ 12315570, 12317654 ]
        Jonathan Eagles made changes -
        Attachment MAPREDUCE-2666.patch [ 12498784 ]
        Jonathan Eagles made changes -
        Attachment MAPREDUCE-2666.patch [ 12498622 ]
        Jonathan Eagles made changes -
        Assignee Robert Joseph Evans [ revans2 ] Jonathan Eagles [ jeagles ]
        Vinod Kumar Vavilapalli made changes -
        Parent MAPREDUCE-2692 [ 12514289 ]
        Issue Type Bug [ 1 ] Sub-task [ 7 ]
        Robert Joseph Evans made changes -
        Summary MR-279: Need to retrieve shuffle port number on AplicationMaster restart MR-279: Need to retrieve shuffle port number on ApplicationMaster restart
        Target Version/s 0.23.0, 0.24.0 [ 12315570, 12317654 ]
        Arun C Murthy made changes -
        Field Original Value New Value
        Priority Major [ 3 ] Blocker [ 1 ]
        Robert Joseph Evans created issue -

          People

          • Assignee:
            Jonathan Eagles
            Reporter:
            Robert Joseph Evans
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development