Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6960

Shuffle Handler prints disk error stack traces for every read failure.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-beta1, 3.1.0, 2.8.3
    • Component/s: None
    • Labels:
      None

      Description

       } catch (IOException e) {
                LOG.error("Shuffle error :", e);
      

      In cases where the read from a disk fails and throws a DiskErrorException, the shuffle handler prints the entire stack trace for each and every one of the failures causing the nodemanager logs to quickly fill up the disk.

        Attachments

          Activity

            People

            • Assignee:
              kshukla Kuhu Shukla
              Reporter:
              kshukla Kuhu Shukla
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: