[HADOOP-13070] classloading isolation improvements for stricter dependencies

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: util
• Target Version/s: 3.5.0
• Hadoop Flags: Incompatible change
• Assignee: Sangjin Lee
• Reporter: Sangjin Lee
• Created: 28/Apr/16 23:21
• Updated: 04/Jan/24 11:36

Description

Related to HADOOP-11656, we would like to make a number of improvements in terms of classloading isolation so that user-code can run safely without worrying about dependency collisions with the Hadoop dependencies.

By the same token, it should raised the quality of the user code and its specified classpath so that users get clear signals if they specify incorrect classpaths.

This will contain a proposal that will include several improvements some of which may not be backward compatible. As such, it should be targeted to the next major revision of Hadoop.

Issue Links

• blocks: HADOOP-13363 Upgrade protobuf from 2.5.0 to something newer
• is related to: HADOOP-11656 Classpath isolation for downstream clients

Sub-Tasks

• prevent user classes from loading classes in the parent classpath with ApplicationClassLoader: Patch Available
• deprecate the Configuration classloader: Open
• update the ApplicationClassLoader implementation in line with latest Java ClassLoader implementation: Resolved
• usability improvements of ApplicationClassLoader: Open