[HADOOP-14067] VersionInfo should load version-info.properties from its own classloader

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.8.3, 3.0.0
• Fix Version/s: 3.1.0
• Component/s: common
• Assignee: Thejas Nair
• Reporter: Thejas Nair
• Created: 07/Feb/17 21:49
• Updated: 09/Jul/20 16:48
• Resolved: 22/Mar/18 21:15

Description

org.apache.hadoop.util.VersionInfo loads the version-info.properties file via the current thread classloader.
However, in case of applications that are using hadoop classes dynamically (eg jdbc based tools such as SQuirreL SQL) the current thread might not be the one that loaded the hadoop classes including VersionInfo, and it would fail to fine the properties file.
The right place to look for the properties file is in the classloader of VersionInfo class, as right version is the one that is associated with rest of the loaded hadoop classes, and not necessarily the one in current thread classloader.

Created a related jira - HADOOP-14066 to make methods to get version via VersionInfo a public api.

Issue Links

• is related to: SPARK-32256 Hive may fail to detect Hadoop version when using isolated classloader
• is related to: HADOOP-14066 VersionInfo should be marked as public API