Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0-alpha1
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
      None

      Description

      Inside Fetcher.java there are a few cases where an error can happen and the corresponding map task is not marked as a fetch failure. One of these is if the Shuffle server returns a malformed result.

      MAPREDUCE-3992 makes this case a lot less common, but it is still possible. IF the shuffle handler always returns a malformed result, but a OK response the Fetcher will never stop trying to fetch those results.

        Attachments

        1. MR-4423-trunk.txt
          15 kB
          Robert Joseph Evans
        2. MR-4423-branch-0.23.txt
          15 kB
          Robert Joseph Evans
        3. MR-4423-trunk.txt
          12 kB
          Robert Joseph Evans
        4. MR-4423.txt
          12 kB
          Robert Joseph Evans
        5. MR-4423.txt
          11 kB
          Robert Joseph Evans
        6. MR-4423.txt
          11 kB
          Robert Joseph Evans

          Activity

            People

            • Assignee:
              revans2 Robert Joseph Evans
              Reporter:
              revans2 Robert Joseph Evans
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: