Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4730

AM crashes due to OOM while serving up map task completion events

    Details

      Description

      We're seeing a repeatable OOM crash in the AM for a task with around 30000 maps and 3000 reducers. Details to follow.

      1. MAPREDUCE-4730.patch
        1.0 kB
        Jason Lowe
      2. MAPREDUCE-4730.patch
        8 kB
        Jason Lowe
      3. MAPREDUCE-4730.patch
        14 kB
        Jason Lowe

        Issue Links

          Activity

          Jason Lowe created issue -
          Jason Lowe made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-4730.patch [ 12549736 ]
          Jason Lowe made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Target Version/s 2.0.3-alpha, 0.23.5 [ 12323275, 12323312 ]
          Assignee Jason Lowe [ jlowe ]
          Jason Lowe made changes -
          Link This issue relates to HADOOP-8942 [ HADOOP-8942 ]
          Jason Lowe made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jason Lowe made changes -
          Attachment MAPREDUCE-4730.patch [ 12549805 ]
          Jason Lowe made changes -
          Link This issue depends on MAPREDUCE-4733 [ MAPREDUCE-4733 ]
          Jason Lowe made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Jason Lowe made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jason Lowe made changes -
          Attachment MAPREDUCE-4730.patch [ 12550687 ]
          Jason Lowe made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Vinod Kumar Vavilapalli made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.0.3-alpha [ 12323275 ]
          Fix Version/s 0.23.5 [ 12323312 ]
          Resolution Fixed [ 1 ]
          Thomas Graves made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue depends on MAPREDUCE-4733 [ MAPREDUCE-4733 ]
          Gavin made changes -
          Link This issue depends upon MAPREDUCE-4733 [ MAPREDUCE-4733 ]

            People

            • Assignee:
              Jason Lowe
              Reporter:
              Jason Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development