[SPARK-14149] Log exceptions in tryOrIOException

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.3, 1.6.2, 2.0.0
• Component/s: Spark Core
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 25/Mar/16 06:12
• Updated: 25/Mar/16 08:19
• Resolved: 25/Mar/16 08:19

Description

We ran into a problem today debugging some class loading problem during deserialization, and JVM was masking the underlying exception which made it very difficult to debug.

We can however log the exceptions using try/catch ourselves in serialization/deserialization. The good thing is that all these methods are already using Utils.tryOrIOException, so we can just put the try catch and logging in a single place.

Issue Links

• links to: [Github] Pull Request #11951 (rxin)