[SPARK-9596] Avoid reloading Hadoop classes like UserGroupInformation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: SQL
• Target Version/s: 1.6.0
• Assignee: Tao Wang (Inactive)
• Reporter: Tao Wang (Inactive)
• Shepherd: Michael Armbrust
• Created: 04/Aug/15 12:50
• Updated: 25/Nov/15 22:18
• Resolved: 03/Sep/15 19:56

Description

Some hadoop classes contains global information such as authentication in UserGroupInformation. If we load them again in `IsolatedClientLoader`, the message they carry will be dropped.

So we should treat hadoop classes as "shared" too.

Issue Links

• is related to: SPARK-11998 Branch 1.6's hadoop 2.2 tests always fail the entire VersionsSuite
• links to: [Github] Pull Request #7931 (WangTaoTheTonic)