Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2, nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Modified ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second.

      Description

      Currently, the ContainerLocalizer to NM heartbeats to the NM every second. Not very significant, but this causes a ~4second delay in jobs (job jar, splits, etc). Instead, it should heartbeat to ask for additional resources to localize as soon as the previous one is localzied. There's already a TODO in the ContainerLocalizer for this.

      1. MR3399_v1.txt
        3 kB
        Siddharth Seth
      2. MR3399_v2.txt
        5 kB
        Siddharth Seth

        Activity

        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Release Note Modified ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second.
        Fix Version/s 0.23.1 [ 12318883 ]
        Resolution Fixed [ 1 ]
        Siddharth Seth made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Siddharth Seth made changes -
        Attachment MR3399_v2.txt [ 12508449 ]
        Siddharth Seth made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Siddharth Seth made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Siddharth Seth made changes -
        Attachment MR3399_v1.txt [ 12508421 ]
        Vinod Kumar Vavilapalli made changes -
        Parent MAPREDUCE-3561 [ 12535237 ]
        Issue Type Improvement [ 4 ] Sub-task [ 7 ]
        Arun C Murthy made changes -
        Assignee Siddharth Seth [ sseth ]
        Arun C Murthy made changes -
        Field Original Value New Value
        Target Version/s 0.23.1 [ 12318883 ]
        Priority Major [ 3 ] Blocker [ 1 ]
        Siddharth Seth created issue -

          People

          • Assignee:
            Siddharth Seth
            Reporter:
            Siddharth Seth
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development