[MAPREDUCE-6960] Shuffle Handler prints disk error stack traces for every read failure.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-beta1, 3.1.0, 2.8.3
• Assignee: Kuhu Shukla
• Reporter: Kuhu Shukla
• Created: 18/Sep/17 20:16
• Updated: 14/Oct/19 15:37
• Resolved: 19/Sep/17 16:11

Description

 } catch (IOException e) {
          LOG.error("Shuffle error :", e);

In cases where the read from a disk fails and throws a DiskErrorException, the shuffle handler prints the entire stack trace for each and every one of the failures causing the nodemanager logs to quickly fill up the disk.