Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
      None

      Description

      Inside Fetcher.java there are a few cases where an error can happen and the corresponding map task is not marked as a fetch failure. One of these is if the Shuffle server returns a malformed result.

      MAPREDUCE-3992 makes this case a lot less common, but it is still possible. IF the shuffle handler always returns a malformed result, but a OK response the Fetcher will never stop trying to fetch those results.

      1. MR-4423.txt
        11 kB
        Robert Joseph Evans
      2. MR-4423.txt
        11 kB
        Robert Joseph Evans
      3. MR-4423.txt
        12 kB
        Robert Joseph Evans
      4. MR-4423-trunk.txt
        12 kB
        Robert Joseph Evans
      5. MR-4423-branch-0.23.txt
        15 kB
        Robert Joseph Evans
      6. MR-4423-trunk.txt
        15 kB
        Robert Joseph Evans

        Activity

        Robert Joseph Evans created issue -
        Robert Joseph Evans made changes -
        Field Original Value New Value
        Summary Potential infinet fetching of map output Potential infinite fetching of map output
        Arun C Murthy made changes -
        Priority Major [ 3 ] Critical [ 2 ]
        Robert Joseph Evans made changes -
        Attachment MR-4423.txt [ 12536897 ]
        Robert Joseph Evans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Robert Joseph Evans made changes -
        Attachment MR-4423.txt [ 12537218 ]
        Thomas Graves made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.23.3 [ 12320060 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Fix Version/s 2.2.0-alpha [ 12322471 ]
        Resolution Fixed [ 1 ]
        Thomas Graves made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Robert Joseph Evans made changes -
        Attachment MR-4423.txt [ 12537898 ]
        Robert Joseph Evans made changes -
        Status Reopened [ 4 ] Patch Available [ 10002 ]
        Thomas Graves made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Robert Joseph Evans made changes -
        Attachment MR-4423-trunk.txt [ 12538008 ]
        Robert Joseph Evans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Robert Joseph Evans made changes -
        Attachment MR-4423-branch-0.23.txt [ 12538082 ]
        Attachment MR-4423-trunk.txt [ 12538083 ]
        Robert Joseph Evans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Thomas Graves made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Fix Version/s 3.0.0 [ 12320355 ]
        Arun C Murthy made changes -
        Affects Version/s 2.0.0-alpha [ 12320354 ]
        Affects Version/s 2.1.0-alpha [ 12321442 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Robert Joseph Evans
            Reporter:
            Robert Joseph Evans
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development