Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11431

hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.8.0, 3.0.0-alpha4
    • Fix Version/s: 2.8.0
    • Component/s: build, hdfs-client
    • Labels:
    • Target Version/s:
    • Release Note:
      Hide
      The hadoop-client POM now includes a leaner hdfs-client, stripping out all the transitive dependencies on JARs only needed for the Hadoop HDFS daemon itself. The specific jars now excluded are: leveldbjni-all, jetty-util, commons-daemon, xercesImpl, netty and servlet-api.

      This should make downstream projects dependent JARs smaller, and avoid version conflict problems with the specific JARs now excluded.

      Applications may encounter build problems if they did depend on these JARs, and which didn't explicitly include them. There are two fixes for this

      * explicitly include the JARs, stating which version of them you want.
      * add a dependency on hadoop-hdfs. For Hadoop 2.8+, this will add the missing dependencies. For builds against older versions of Hadoop, this will be harmless, as hadoop-hdfs and all its dependencies are already pulled in by the hadoop-client POM.
      Show
      The hadoop-client POM now includes a leaner hdfs-client, stripping out all the transitive dependencies on JARs only needed for the Hadoop HDFS daemon itself. The specific jars now excluded are: leveldbjni-all, jetty-util, commons-daemon, xercesImpl, netty and servlet-api. This should make downstream projects dependent JARs smaller, and avoid version conflict problems with the specific JARs now excluded. Applications may encounter build problems if they did depend on these JARs, and which didn't explicitly include them. There are two fixes for this * explicitly include the JARs, stating which version of them you want. * add a dependency on hadoop-hdfs. For Hadoop 2.8+, this will add the missing dependencies. For builds against older versions of Hadoop, this will be harmless, as hadoop-hdfs and all its dependencies are already pulled in by the hadoop-client POM.

      Description

      The hadoop-hdfs-client-2.8.0.jar file does include the ConfiguredFailoverProxyProvider class. This breaks client applications that use this class to communicate with the active NameNode in an HA deployment of HDFS.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Steven Rand Steven Rand
                Reporter:
                Steven Rand Steven Rand
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: