[HADOOP-12596] FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: fs
• Assignee: Himanshu Gupta
• Reporter: Himanshu Gupta
• Created: 10/Jul/15 03:27
• Updated: 24/Nov/15 21:56

Description

In FileSystem.loadFileSystems(), at
https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java#L2652

a "scheme" -> "FileSystem implementation" map is created from the jars available on classpath. It uses Thread.currentThread().getClassLoader() via ServiceLoader.load(FileSystem.class)

Instead, loadFileSystems() should take Configuration as an argument and should first check if a classloader is configured in configuration.getClassLoader(), if yes then ServiceLoader.load(FileSystem.class, configuration.getClassLoader()) should be used.