Hadoop Common
  1. Hadoop Common
  2. HADOOP-9905

remove dependency of zookeeper for hadoop-client

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 2.1.0-beta, 2.0.6-alpha
    • Fix Version/s: 3.0.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Zookeeper jar removed from hadoop-client dependency tree.

      Description

      zookeeper dependency was added for ZKFC, which will not be used by client.
      Better remove the dependency of zookeeper jar for hadoop-client

      1. HADOOP-9905.patch
        0.8 kB
        Vinayakumar B
      2. HADOOP-9905-02.patch
        0.8 kB
        Vinayakumar B

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #205 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/205/)
          HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-client/pom.xml
          Show
          Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #205 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/205/ ) HADOOP-9905 . remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-client/pom.xml
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2144 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2144/)
          HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-client/pom.xml
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2144 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2144/ ) HADOOP-9905 . remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-client/pom.xml
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #946 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/946/)
          HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c)

          • hadoop-client/pom.xml
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #946 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/946/ ) HADOOP-9905 . remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c) hadoop-client/pom.xml hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #216 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/216/)
          HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c)

          • hadoop-client/pom.xml
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #216 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/216/ ) HADOOP-9905 . remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c) hadoop-client/pom.xml hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2161 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2161/)
          HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-client/pom.xml
          Show
          Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2161 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2161/ ) HADOOP-9905 . remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-client/pom.xml
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #213 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/213/)
          HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c)

          • hadoop-client/pom.xml
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #213 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/213/ ) HADOOP-9905 . remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c) hadoop-client/pom.xml hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7939 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7939/)
          HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-client/pom.xml
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7939 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7939/ ) HADOOP-9905 . remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B) (vinayakumarb: rev 63e3fee5f6c2c50932e474993ad6c663f47c222c) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-client/pom.xml
          Hide
          Vinayakumar B added a comment -

          Committed to trunk.
          Thanks for reviews.

          Show
          Vinayakumar B added a comment - Committed to trunk. Thanks for reviews.
          Hide
          Vinayakumar B added a comment -

          Since +1 already got for earlier version of patch,
          Will commit tomorrow, if no one have objections by then.
          Thanks

          Show
          Vinayakumar B added a comment - Since +1 already got for earlier version of patch, Will commit tomorrow, if no one have objections by then. Thanks
          Hide
          Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 15m 10s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 48s There were no new javac warning messages.
          +1 javadoc 9m 59s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 33s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 client tests 0m 12s Tests passed in hadoop-client.
              35m 39s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12732544/HADOOP-9905-02.patch
          Optional Tests javadoc javac unit
          git revision trunk / 065d8f2
          hadoop-client test log https://builds.apache.org/job/PreCommit-HADOOP-Build/6685/artifact/patchprocess/testrun_hadoop-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/6685/testReport/
          Java 1.7.0_55
          uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/6685/console

          This message was automatically generated.

          Show
          Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 10s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 48s There were no new javac warning messages. +1 javadoc 9m 59s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 client tests 0m 12s Tests passed in hadoop-client.     35m 39s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12732544/HADOOP-9905-02.patch Optional Tests javadoc javac unit git revision trunk / 065d8f2 hadoop-client test log https://builds.apache.org/job/PreCommit-HADOOP-Build/6685/artifact/patchprocess/testrun_hadoop-client.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/6685/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/6685/console This message was automatically generated.
          Hide
          Vinayakumar B added a comment -

          Rebased the patch. It was applying at wrong place due to line number mismatch.
          Kindly review again.

          mvn dependency:tree after applying for hadoop-client

           org.apache.hadoop:hadoop-client:jar:3.0.0-SNAPSHOT
           +- org.apache.hadoop:hadoop-common:jar:3.0.0-SNAPSHOT:compile
           |  +- com.google.guava:guava:jar:11.0.2:compile
           |  +- commons-cli:commons-cli:jar:1.2:compile
           |  +- org.apache.commons:commons-math3:jar:3.1.1:compile
           |  +- xmlenc:xmlenc:jar:0.52:compile
           |  +- commons-httpclient:commons-httpclient:jar:3.1:compile
           |  +- commons-codec:commons-codec:jar:1.4:compile
           |  +- commons-io:commons-io:jar:2.4:compile
           |  +- commons-net:commons-net:jar:3.1:compile
           |  +- commons-collections:commons-collections:jar:3.2.1:compile
           |  +- javax.servlet.jsp:jsp-api:jar:2.1:runtime
           |  +- commons-logging:commons-logging:jar:1.1.3:compile
           |  +- log4j:log4j:jar:1.2.17:compile
           |  +- commons-lang:commons-lang:jar:2.6:compile
           |  +- commons-configuration:commons-configuration:jar:1.6:compile
           |  |  +- commons-digester:commons-digester:jar:1.8:compile
           |  |  |  \- commons-beanutils:commons-beanutils:jar:1.7.0:compile
           |  |  \- commons-beanutils:commons-beanutils-core:jar:1.8.0:compile
           |  +- org.slf4j:slf4j-api:jar:1.7.10:compile
           |  +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile
           |  +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile
           |  +- org.apache.avro:avro:jar:1.7.4:compile
           |  |  +- com.thoughtworks.paranamer:paranamer:jar:2.3:compile
           |  |  \- org.xerial.snappy:snappy-java:jar:1.0.4.1:compile
           |  +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
           |  +- com.google.code.gson:gson:jar:2.2.4:compile
           |  +- org.apache.hadoop:hadoop-auth:jar:3.0.0-SNAPSHOT:compile
           |  |  +- org.apache.httpcomponents:httpclient:jar:4.2.5:compile
           |  |  |  \- org.apache.httpcomponents:httpcore:jar:4.2.5:compile (version managed from 4.2.4)
           |  |  +- com.nimbusds:nimbus-jose-jwt:jar:3.9:compile
           |  |  |  +- net.jcip:jcip-annotations:jar:1.0:compile
           |  |  |  \- net.minidev:json-smart:jar:1.1.1:compile
           |  |  +- org.apache.directory.server:apacheds-kerberos-codec:jar:2.0.0-M15:compile
           |  |  |  +- org.apache.directory.server:apacheds-i18n:jar:2.0.0-M15:compile
           |  |  |  +- org.apache.directory.api:api-asn1-api:jar:1.0.0-M20:compile
           |  |  |  \- org.apache.directory.api:api-util:jar:1.0.0-M20:compile
           |  |  \- org.apache.curator:curator-framework:jar:2.7.1:compile
           |  +- org.apache.curator:curator-client:jar:2.7.1:compile
           |  +- org.apache.curator:curator-recipes:jar:2.7.1:compile
           |  +- com.google.code.findbugs:jsr305:jar:3.0.0:compile
           |  +- org.apache.htrace:htrace-core:jar:3.1.0-incubating:compile
           |  \- org.apache.commons:commons-compress:jar:1.4.1:compile
           |     \- org.tukaani:xz:jar:1.0:compile
           +- org.apache.hadoop:hadoop-hdfs:jar:3.0.0-SNAPSHOT:compile
           |  +- org.apache.hadoop:hadoop-hdfs-client:jar:3.0.0-SNAPSHOT:compile
           |  +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
           |  +- io.netty:netty-all:jar:4.0.23.Final:compile
           |  +- xerces:xercesImpl:jar:2.9.1:compile
           |  |  \- xml-apis:xml-apis:jar:1.3.04:compile
           |  \- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:compile
           +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:3.0.0-SNAPSHOT:compile
           |  +- org.apache.hadoop:hadoop-mapreduce-client-common:jar:3.0.0-SNAPSHOT:compile
           |  |  +- org.apache.hadoop:hadoop-yarn-client:jar:3.0.0-SNAPSHOT:compile
           |  |  \- org.apache.hadoop:hadoop-yarn-server-common:jar:3.0.0-SNAPSHOT:compile
           |  +- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-SNAPSHOT:compile
           |  \- org.slf4j:slf4j-log4j12:jar:1.7.10:compile
           +- org.apache.hadoop:hadoop-yarn-api:jar:3.0.0-SNAPSHOT:compile
           +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:3.0.0-SNAPSHOT:compile
           |  \- org.apache.hadoop:hadoop-yarn-common:jar:3.0.0-SNAPSHOT:compile
           |     +- javax.xml.bind:jaxb-api:jar:2.2.2:compile
           |     |  +- javax.xml.stream:stax-api:jar:1.0-2:compile
           |     |  \- javax.activation:activation:jar:1.1:compile
           |     +- javax.servlet:servlet-api:jar:2.5:compile
           |     +- com.sun.jersey:jersey-core:jar:1.9:compile
           |     +- com.sun.jersey:jersey-client:jar:1.9:compile
           |     +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.13:compile (version managed from 1.8.3)
           |     \- org.codehaus.jackson:jackson-xc:jar:1.9.13:compile (version managed from 1.8.3)
           +- org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:3.0.0-SNAPSHOT:compile
           \- org.apache.hadoop:hadoop-annotations:jar:3.0.0-SNAPSHOT:compile
          Show
          Vinayakumar B added a comment - Rebased the patch. It was applying at wrong place due to line number mismatch. Kindly review again. mvn dependency:tree after applying for hadoop-client org.apache.hadoop:hadoop-client:jar:3.0.0-SNAPSHOT +- org.apache.hadoop:hadoop-common:jar:3.0.0-SNAPSHOT:compile | +- com.google.guava:guava:jar:11.0.2:compile | +- commons-cli:commons-cli:jar:1.2:compile | +- org.apache.commons:commons-math3:jar:3.1.1:compile | +- xmlenc:xmlenc:jar:0.52:compile | +- commons-httpclient:commons-httpclient:jar:3.1:compile | +- commons-codec:commons-codec:jar:1.4:compile | +- commons-io:commons-io:jar:2.4:compile | +- commons-net:commons-net:jar:3.1:compile | +- commons-collections:commons-collections:jar:3.2.1:compile | +- javax.servlet.jsp:jsp-api:jar:2.1:runtime | +- commons-logging:commons-logging:jar:1.1.3:compile | +- log4j:log4j:jar:1.2.17:compile | +- commons-lang:commons-lang:jar:2.6:compile | +- commons-configuration:commons-configuration:jar:1.6:compile | | +- commons-digester:commons-digester:jar:1.8:compile | | | \- commons-beanutils:commons-beanutils:jar:1.7.0:compile | | \- commons-beanutils:commons-beanutils-core:jar:1.8.0:compile | +- org.slf4j:slf4j-api:jar:1.7.10:compile | +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile | +- org.apache.avro:avro:jar:1.7.4:compile | | +- com.thoughtworks.paranamer:paranamer:jar:2.3:compile | | \- org.xerial.snappy:snappy-java:jar:1.0.4.1:compile | +- com.google.protobuf:protobuf-java:jar:2.5.0:compile | +- com.google.code.gson:gson:jar:2.2.4:compile | +- org.apache.hadoop:hadoop-auth:jar:3.0.0-SNAPSHOT:compile | | +- org.apache.httpcomponents:httpclient:jar:4.2.5:compile | | | \- org.apache.httpcomponents:httpcore:jar:4.2.5:compile (version managed from 4.2.4) | | +- com.nimbusds:nimbus-jose-jwt:jar:3.9:compile | | | +- net.jcip:jcip-annotations:jar:1.0:compile | | | \- net.minidev:json-smart:jar:1.1.1:compile | | +- org.apache.directory.server:apacheds-kerberos-codec:jar:2.0.0-M15:compile | | | +- org.apache.directory.server:apacheds-i18n:jar:2.0.0-M15:compile | | | +- org.apache.directory.api:api-asn1-api:jar:1.0.0-M20:compile | | | \- org.apache.directory.api:api-util:jar:1.0.0-M20:compile | | \- org.apache.curator:curator-framework:jar:2.7.1:compile | +- org.apache.curator:curator-client:jar:2.7.1:compile | +- org.apache.curator:curator-recipes:jar:2.7.1:compile | +- com.google.code.findbugs:jsr305:jar:3.0.0:compile | +- org.apache.htrace:htrace-core:jar:3.1.0-incubating:compile | \- org.apache.commons:commons-compress:jar:1.4.1:compile | \- org.tukaani:xz:jar:1.0:compile +- org.apache.hadoop:hadoop-hdfs:jar:3.0.0-SNAPSHOT:compile | +- org.apache.hadoop:hadoop-hdfs-client:jar:3.0.0-SNAPSHOT:compile | +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile | +- io.netty:netty-all:jar:4.0.23.Final:compile | +- xerces:xercesImpl:jar:2.9.1:compile | | \- xml-apis:xml-apis:jar:1.3.04:compile | \- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:compile +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:3.0.0-SNAPSHOT:compile | +- org.apache.hadoop:hadoop-mapreduce-client-common:jar:3.0.0-SNAPSHOT:compile | | +- org.apache.hadoop:hadoop-yarn-client:jar:3.0.0-SNAPSHOT:compile | | \- org.apache.hadoop:hadoop-yarn-server-common:jar:3.0.0-SNAPSHOT:compile | +- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-SNAPSHOT:compile | \- org.slf4j:slf4j-log4j12:jar:1.7.10:compile +- org.apache.hadoop:hadoop-yarn-api:jar:3.0.0-SNAPSHOT:compile +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:3.0.0-SNAPSHOT:compile | \- org.apache.hadoop:hadoop-yarn-common:jar:3.0.0-SNAPSHOT:compile | +- javax.xml.bind:jaxb-api:jar:2.2.2:compile | | +- javax.xml.stream:stax-api:jar:1.0-2:compile | | \- javax.activation:activation:jar:1.1:compile | +- javax.servlet:servlet-api:jar:2.5:compile | +- com.sun.jersey:jersey-core:jar:1.9:compile | +- com.sun.jersey:jersey-client:jar:1.9:compile | +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.13:compile (version managed from 1.8.3) | \- org.codehaus.jackson:jackson-xc:jar:1.9.13:compile (version managed from 1.8.3) +- org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:3.0.0-SNAPSHOT:compile \- org.apache.hadoop:hadoop-annotations:jar:3.0.0-SNAPSHOT:compile
          Hide
          Allen Wittenauer added a comment -

          I'm +1 for trunk only.

          Show
          Allen Wittenauer added a comment - I'm +1 for trunk only.
          Hide
          nijel added a comment -

          thanks Vinayakumar B for the patch
          lgtm
          +1

          Show
          nijel added a comment - thanks Vinayakumar B for the patch lgtm +1
          Hide
          Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 15m 6s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 40s There were no new javac warning messages.
          +1 javadoc 10m 0s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 37s mvn install still works.
          +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
          +1 client tests 0m 13s Tests passed in hadoop-client.
              35m 36s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12599942/HADOOP-9905.patch
          Optional Tests javadoc javac unit
          git revision trunk / 6ae2a0d
          hadoop-client test log https://builds.apache.org/job/PreCommit-HADOOP-Build/6423/artifact/patchprocess/testrun_hadoop-client.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/6423/testReport/
          Java 1.7.0_55
          uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/6423/console

          This message was automatically generated.

          Show
          Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 6s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 40s There were no new javac warning messages. +1 javadoc 10m 0s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 37s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 client tests 0m 13s Tests passed in hadoop-client.     35m 36s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12599942/HADOOP-9905.patch Optional Tests javadoc javac unit git revision trunk / 6ae2a0d hadoop-client test log https://builds.apache.org/job/PreCommit-HADOOP-Build/6423/artifact/patchprocess/testrun_hadoop-client.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/6423/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/6423/console This message was automatically generated.
          Hide
          Vinayakumar B added a comment -

          Defining in server pom may not be required. That will be inherited from hadoop common dependency. Excluding in hadoop client will not affect that.

          Show
          Vinayakumar B added a comment - Defining in server pom may not be required. That will be inherited from hadoop common dependency. Excluding in hadoop client will not affect that.
          Hide
          Steve Loughran added a comment -

          @Vinay -yes, but we need to make sure that the server POMs are set up to pull it in once the client POM drops it

          Show
          Steve Loughran added a comment - @Vinay -yes, but we need to make sure that the server POMs are set up to pull it in once the client POM drops it
          Hide
          Vinayakumar B added a comment -

          Thanks steve.
          As for as Yarn is concerned Vinod has already confirmed that zookeeper dependency required only for server. Removing it will not affect the clients.

          Show
          Vinayakumar B added a comment - Thanks steve. As for as Yarn is concerned Vinod has already confirmed that zookeeper dependency required only for server. Removing it will not affect the clients.
          Hide
          Steve Loughran added a comment -

          Alejandro, I'm still up for dropping the dependency on ZK

          We can't have a "no changes to POMs or dependencies in Hadoop 2" policy. To do so says "we can't ever upgrade any POM we depend on, in case transient dependencies change"

          1. we explicitly say "no guarantees about dependencies" in the compatibility document. That was not an accident.
          2. this only affects downstream apps that work via maven, not production code
          3. we can mark it as 'incompatible" in the changes.

          The patch isn't ready yet as we need to make sure YARN is up with it. But otherwise, I will eventually +1 a patch that drops ZK from hadoop-cliient

          Show
          Steve Loughran added a comment - Alejandro, I'm still up for dropping the dependency on ZK We can't have a "no changes to POMs or dependencies in Hadoop 2" policy. To do so says "we can't ever upgrade any POM we depend on, in case transient dependencies change" we explicitly say "no guarantees about dependencies" in the compatibility document. That was not an accident. this only affects downstream apps that work via maven, not production code we can mark it as 'incompatible" in the changes. The patch isn't ready yet as we need to make sure YARN is up with it. But otherwise, I will eventually +1 a patch that drops ZK from hadoop-cliient
          Hide
          Alejandro Abdelnur added a comment -

          we are past Hadoop 2 GA, removing this dependency in Hadoop 2 now would break backward compatibility for apps using ZK (and expecting Hadoop to provide it)

          Show
          Alejandro Abdelnur added a comment - we are past Hadoop 2 GA, removing this dependency in Hadoop 2 now would break backward compatibility for apps using ZK (and expecting Hadoop to provide it)
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12599942/HADOOP-9905.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          -1 javadoc. The javadoc tool appears to have generated 2 warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-client.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3530//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3530//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12599942/HADOOP-9905.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. -1 javadoc . The javadoc tool appears to have generated 2 warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-client. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3530//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3530//console This message is automatically generated.
          Hide
          Vinayakumar B added a comment -

          Hi All,
          Any changes required on this jira..?
          If no changes required can push this in..?
          Thanks

          Show
          Vinayakumar B added a comment - Hi All, Any changes required on this jira..? If no changes required can push this in..? Thanks
          Hide
          Vinod Kumar Vavilapalli added a comment -

          if yarn-client (& hence mapred-client) needs ZK, then it should be an explict dependency in those modules.

          It's not the client, the server needs it. Hopefully removing it from client doesn't affect our setup for YARN servers.

          Show
          Vinod Kumar Vavilapalli added a comment - if yarn-client (& hence mapred-client) needs ZK, then it should be an explict dependency in those modules. It's not the client, the server needs it. Hopefully removing it from client doesn't affect our setup for YARN servers.
          Hide
          Steve Loughran added a comment -

          Konstantin, if yarn-client (& hence mapred-client) needs ZK, then it should be an explict dependency in those modules. We should warn them though

          Show
          Steve Loughran added a comment - Konstantin, if yarn-client (& hence mapred-client) needs ZK, then it should be an explict dependency in those modules. We should warn them though
          Hide
          Vinayakumar B added a comment -

          Any more updation required on this jira..?

          Show
          Vinayakumar B added a comment - Any more updation required on this jira..?
          Hide
          Konstantin Boudnik added a comment -

          Thanks, I knew I was misreading it... needs more coffee.

          Show
          Konstantin Boudnik added a comment - Thanks, I knew I was misreading it... needs more coffee.
          Hide
          Alejandro Abdelnur added a comment -

          the patch does an exclusion, it seems OK, still have to verify it.

          Show
          Alejandro Abdelnur added a comment - the patch does an exclusion, it seems OK, still have to verify it.
          Hide
          Konstantin Boudnik added a comment -

          Also, it seems that the patch actually adds the dependency to hadoop-client. Am I reading the patch wrong?

          Show
          Konstantin Boudnik added a comment - Also, it seems that the patch actually adds the dependency to hadoop-client. Am I reading the patch wrong?
          Hide
          Alejandro Abdelnur added a comment -

          I just checked with Aaron T. Myers and he said that I'm wrong, that the HDFS HA client does not use ZK. Please disregard my previous comment.

          Show
          Alejandro Abdelnur added a comment - I just checked with Aaron T. Myers and he said that I'm wrong, that the HDFS HA client does not use ZK. Please disregard my previous comment.
          Hide
          Konstantin Boudnik added a comment -

          I presume it also affects 2.0.6-alpha, right?

          Show
          Konstantin Boudnik added a comment - I presume it also affects 2.0.6-alpha, right?
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12599942/HADOOP-9905.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-client.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3019//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3019//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12599942/HADOOP-9905.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-client. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/3019//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/3019//console This message is automatically generated.
          Hide
          Alejandro Abdelnur added a comment -

          AFAIK HDFS HA client (and soon YARN HA client) uses ZK, thus it is required.

          Show
          Alejandro Abdelnur added a comment - AFAIK HDFS HA client (and soon YARN HA client) uses ZK, thus it is required.
          Hide
          Vinayakumar B added a comment -

          Attaching patch for exclusion

          Show
          Vinayakumar B added a comment - Attaching patch for exclusion

            People

            • Assignee:
              Vinayakumar B
              Reporter:
              Vinayakumar B
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development