Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mr-am, mrv2
    • Labels:
      None

      Description

      The construction of the context is expensive, includes per-task trips to NameNode for obtaining the information about job.jar, job splits etc which is redundant across all tasks.

      We should have a common job-level context and a task-specific context inheriting from the common job-level context.

      1. MAPREDUCE-3566-20120103.txt
        25 kB
        Vinod Kumar Vavilapalli
      2. MAPREDUCE-3566-20120103.1.txt
        25 kB
        Vinod Kumar Vavilapalli
      3. MAPREDUCE-3566-20111220.txt
        15 kB
        Vinod Kumar Vavilapalli
      4. MAPREDUCE-3566-20111215.txt
        12 kB
        Vinod Kumar Vavilapalli
      5. MAPREDUCE-3566.patch
        27 kB
        Arun C Murthy

        Activity

        Vinod Kumar Vavilapalli created issue -
        Vinod Kumar Vavilapalli made changes -
        Field Original Value New Value
        Parent MAPREDUCE-3561 [ 12535237 ]
        Issue Type Bug [ 1 ] Sub-task [ 7 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment MAPREDUCE-3566-20111215.txt [ 12507570 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment MAPREDUCE-3566-20111220.txt [ 12508160 ]
        Vinod Kumar Vavilapalli made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Mahadev konar made changes -
        Priority Major [ 3 ] Critical [ 2 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment MAPREDUCE-3566-20120103.txt [ 12509321 ]
        Vinod Kumar Vavilapalli made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment MAPREDUCE-3566-20120103.1.txt [ 12509334 ]
        Vinod Kumar Vavilapalli made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Arun C Murthy made changes -
        Attachment MAPREDUCE-3566.patch [ 12509468 ]
        Arun C Murthy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Vinod Kumar Vavilapalli
            Reporter:
            Vinod Kumar Vavilapalli
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development