[HDFS-11431] hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.8.0, 3.0.0-alpha4
• Fix Version/s: 2.8.0
• Component/s: build, hdfs-client
• Labels: maven
• Target Version/s: 2.8.0

Release Note

The hadoop-client POM now includes a leaner hdfs-client, stripping out all the transitive dependencies on JARs only needed for the Hadoop HDFS daemon itself. The specific jars now excluded are: leveldbjni-all, jetty-util, commons-daemon, xercesImpl, netty and servlet-api.

This should make downstream projects dependent JARs smaller, and avoid version conflict problems with the specific JARs now excluded.

Applications may encounter build problems if they did depend on these JARs, and which didn't explicitly include them. There are two fixes for this

* explicitly include the JARs, stating which version of them you want.
* add a dependency on hadoop-hdfs. For Hadoop 2.8+, this will add the missing dependencies. For builds against older versions of Hadoop, this will be harmless, as hadoop-hdfs and all its dependencies are already pulled in by the hadoop-client POM.

• Assignee: Steven Rand
• Reporter: Steven Rand
• Created: 20/Feb/17 01:13
• Updated: 24/Mar/17 01:10
• Resolved: 16/Mar/17 19:25

Description

The hadoop-hdfs-client-2.8.0.jar file does include the ConfiguredFailoverProxyProvider class. This breaks client applications that use this class to communicate with the active NameNode in an HA deployment of HDFS.

Issue Links

• is superceded by: HDFS-11538 Move ClientProtocol HA proxies into hadoop-hdfs-client