Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11515

Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We had an application sitting on top of Hadoop and got problems using jsch once we switched to java 7. Got this exception:

       com.jcraft.jsch.JSchException: verify: false
      	at com.jcraft.jsch.Session.connect(Session.java:330)
      	at com.jcraft.jsch.Session.connect(Session.java:183)
      

      Upgrading to jsch-0.1.51 from jsch-0.1.49 fixed the issue for us, but then it got in conflict with hadoop's jsch version (we fixed this for us by jarjar'ing our jsch version).

      So i think jsch got introduce by namenode HA (HDFS-1623). So you guys should check if the ssh part is properly working for java7 or preventively upgrade the jsch lib to jsch-0.1.51!

      Some references to problems reported:

      1. HADOOP-11515.001.patch
        0.4 kB
        Tsuyoshi Ozawa
      2. HDFS-7376.1.patch
        0.4 kB
        Tsuyoshi Ozawa

        Issue Links

          Activity

          Hide
          stevel@apache.org Steve Loughran added a comment -

          not seen any reports of this yet but it still seems worth doing. It's too late to do it for 2.6; targeting 2.7, which is java7+ only

          Show
          stevel@apache.org Steve Loughran added a comment - not seen any reports of this yet but it still seems worth doing. It's too late to do it for 2.6; targeting 2.7, which is java7+ only
          Hide
          stevel@apache.org Steve Loughran added a comment -

          do you have a patch for this?

          Show
          stevel@apache.org Steve Loughran added a comment - do you have a patch for this?
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Attaching first patch.

          Show
          ozawa Tsuyoshi Ozawa added a comment - Attaching first patch.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          Moved to hadoop common; resubmitting patch

          Show
          stevel@apache.org Steve Loughran added a comment - Moved to hadoop common; resubmitting patch
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12694953/HDFS-7376.1.patch
          against trunk revision d12dd47.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9356//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9356//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12694953/HDFS-7376.1.patch against trunk revision d12dd47. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9356//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9356//console This message is automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12694953/HDFS-7376.1.patch
          against trunk revision d12dd47.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5518//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5518//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12694953/HDFS-7376.1.patch against trunk revision d12dd47. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5518//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5518//console This message is automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 5s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 48s There were no new javac warning messages.
          +1 javadoc 10m 10s There were no new javadoc warning messages.
          -1 release audit 0m 20s The applied patch generated 1 release audit warnings.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 29s mvn install still works.
          +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
              36m 30s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12694953/HDFS-7376.1.patch
          Optional Tests javadoc javac unit
          git revision trunk / 7e2c971
          Release Audit https://builds.apache.org/job/PreCommit-HADOOP-Build/7795/artifact/patchprocess/patchReleaseAuditProblems.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7795/testReport/
          Java 1.7.0_55
          uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7795/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 5s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 48s There were no new javac warning messages. +1 javadoc 10m 10s There were no new javadoc warning messages. -1 release audit 0m 20s The applied patch generated 1 release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 29s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.     36m 30s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12694953/HDFS-7376.1.patch Optional Tests javadoc javac unit git revision trunk / 7e2c971 Release Audit https://builds.apache.org/job/PreCommit-HADOOP-Build/7795/artifact/patchprocess/patchReleaseAuditProblems.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7795/testReport/ Java 1.7.0_55 uname Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7795/console This message was automatically generated.
          Hide
          kihwal Kihwal Lee added a comment -

          +1

          Show
          kihwal Kihwal Lee added a comment - +1
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Hmm, the release audit looks not related to the patch I uploaded. Kicking Jenkins again.

          Show
          ozawa Tsuyoshi Ozawa added a comment - Hmm, the release audit looks not related to the patch I uploaded. Kicking Jenkins again.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          RAT failure is known and covered in HDFS JIRAs; don't worry about it

          Show
          stevel@apache.org Steve Loughran added a comment - RAT failure is known and covered in HDFS JIRAs; don't worry about it
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Thanks for the notification. OK. Committing this shortly.

          Show
          ozawa Tsuyoshi Ozawa added a comment - Thanks for the notification. OK. Committing this shortly.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 15m 47s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 8m 0s There were no new javac warning messages.
          +1 javadoc 10m 40s There were no new javadoc warning messages.
          +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 31s mvn install still works.
          +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse.
              37m 3s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12766389/HADOOP-11515.001.patch
          Optional Tests javadoc javac unit
          git revision trunk / 6716f15
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7804/testReport/
          Java 1.7.0_55
          uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7804/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 47s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 0s There were no new javac warning messages. +1 javadoc 10m 40s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 31s mvn install still works. +1 eclipse:eclipse 0m 36s The patch built with eclipse:eclipse.     37m 3s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12766389/HADOOP-11515.001.patch Optional Tests javadoc javac unit git revision trunk / 6716f15 Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/7804/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/7804/console This message was automatically generated.
          Hide
          ozawa Tsuyoshi Ozawa added a comment -

          Committed this to trunk and branch-2.
          Thanks Kihwal Lee for your review and thanks Steve Loughran for working with me!

          Show
          ozawa Tsuyoshi Ozawa added a comment - Committed this to trunk and branch-2. Thanks Kihwal Lee for your review and thanks Steve Loughran for working with me!
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8624 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8624/)
          HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec)

          • hadoop-project/pom.xml
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8624 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8624/ ) HADOOP-11515 . Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec) hadoop-project/pom.xml hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2470 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2470/)
          HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec)

          • hadoop-project/pom.xml
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2470 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2470/ ) HADOOP-11515 . Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec) hadoop-project/pom.xml hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1259 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1259/)
          HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-project/pom.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1259 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1259/ ) HADOOP-11515 . Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-project/pom.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #524 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/524/)
          HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-project/pom.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #524 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/524/ ) HADOOP-11515 . Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-project/pom.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #535 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/535/)
          HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-project/pom.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #535 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/535/ ) HADOOP-11515 . Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-project/pom.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #491 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/491/)
          HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-project/pom.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #491 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/491/ ) HADOOP-11515 . Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-project/pom.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2429 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2429/)
          HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-project/pom.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2429 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2429/ ) HADOOP-11515 . Upgrade jsch lib to jsch-0.1.51 to avoid problems running (ozawa: rev 33fefa33e51133aaf1e699e087e3bca2e8065eec) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-project/pom.xml

            People

            • Assignee:
              ozawa Tsuyoshi Ozawa
              Reporter:
              oae Johannes Zillmann
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development