Hive
  1. Hive
  2. HIVE-6660

HiveServer2 running in non-http mode closes server socket for an SSL connection after the 1st request

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.13.0
    • Component/s: HiveServer2, JDBC
    • Labels:
      None

      Description

      Beeline connection string:

      !connect jdbc:hive2://<host>:10000/;ssl=true;sslTrustStore=/usr/share/doc/hive-0.13.0.2.1.1.0/examples/files/truststore.jks;trustStorePassword=HiveJdbc vgumashta vgumashta org.apache.hive.jdbc.HiveDriver 
      

      Error:

      pool-7-thread-1, handling exception: java.net.SocketTimeoutException: Read timed out
      pool-7-thread-1, called close()
      pool-7-thread-1, called closeInternal(true)
      pool-7-thread-1, SEND TLSv1 ALERT:  warning, description = close_notify
      Padded plaintext before ENCRYPTION:  len = 32
      0000: 01 00 BE 72 AC 10 3B FA   4E 01 A5 DE 9B 14 16 AF  ...r..;.N.......
      0010: 4E DD 7A 29 AD B4 09 09   09 09 09 09 09 09 09 09  N.z)............
      pool-7-thread-1, WRITE: TLSv1 Alert, length = 32
      [Raw write]: length = 37
      0000: 15 03 01 00 20 6C 37 82   A8 52 40 DA FB 83 2D CD  .... l7..R@...-.
      0010: 96 9F F0 B7 22 17 E1 04   C1 D1 93 1B C4 39 5A B0  ...."........9Z.
      0020: A2 3F 5D 7D 2D                                     .?].-
      pool-7-thread-1, called closeSocket(selfInitiated)
      pool-7-thread-1, called close()
      pool-7-thread-1, called closeInternal(true)
      pool-7-thread-1, called close()
      pool-7-thread-1, called closeInternal(true)
      

      Subsequent queries fail:

      main, WRITE: TLSv1 Application Data, length = 144
      main, handling exception: java.net.SocketException: Broken pipe
      %% Invalidated:  [Session-1, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA]
      main, SEND TLSv1 ALERT:  fatal, description = unexpected_message
      Padded plaintext before ENCRYPTION:  len = 32
      0000: 02 0A 52 C3 18 B1 C1 38   DB 3F B6 D1 C5 CA 14 9C  ..R....8.?......
      0010: A5 38 4C 01 31 69 09 09   09 09 09 09 09 09 09 09  .8L.1i..........
      main, WRITE: TLSv1 Alert, length = 32
      main, Exception sending alert: java.net.SocketException: Broken pipe
      main, called closeSocket()
      Error: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe (state=08S01,code=0)
      java.sql.SQLException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
      	at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:226)
      	at org.apache.hive.beeline.Commands.execute(Commands.java:736)
      	at org.apache.hive.beeline.Commands.sql(Commands.java:657)
      	at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:796)
      	at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:659)
      	at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:368)
      	at org.apache.hive.beeline.BeeLine.main(BeeLine.java:351)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:601)
      	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
      Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
      	at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161)
      	at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:471)
      	at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37)
      	at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65)
      	at org.apache.hive.service.cli.thrift.TCLIService$Client.send_ExecuteStatement(TCLIService.java:219)
      	at org.apache.hive.service.cli.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:211)
      	at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:220)
      	... 11 more
      Caused by: java.net.SocketException: Broken pipe
      	at java.net.SocketOutputStream.socketWrite0(Native Method)
      	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
      	at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
      	at sun.security.ssl.OutputRecord.writeBuffer(OutputRecord.java:377)
      	at sun.security.ssl.OutputRecord.write(OutputRecord.java:363)
      	at sun.security.ssl.SSLSocketImpl.writeRecordInternal(SSLSocketImpl.java:830)
      	at sun.security.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:801)
      	at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:122)
      	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
      	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
      	at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:159)
      	... 17 more
      

      Works fine however in http mode using ssl.

      1. hive-site.xml
        4 kB
        Vaibhav Gumashta
      2. HIVE-6660.1.patch
        0.7 kB
        Prasad Mujumdar
      3. HIVE-6660.1.patch
        0.7 kB
        Prasad Mujumdar

        Issue Links

          Activity

          Hide
          Prasad Mujumdar added a comment -

          [~vaibhavgumashta] I am not seeing this on the trunk. Repeated SSL connections work fine for me.
          Are you seeing this on 0.13 branch ? Would you mind sharing your config.

          Show
          Prasad Mujumdar added a comment - [~vaibhavgumashta] I am not seeing this on the trunk. Repeated SSL connections work fine for me. Are you seeing this on 0.13 branch ? Would you mind sharing your config.
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar Tried on 13. Attached is my hive-site. Let me try and see if trunk works fine.

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar Tried on 13. Attached is my hive-site. Let me try and see if trunk works fine.
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar I am seeing this on trunk as well.

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar I am seeing this on trunk as well.
          Hide
          Prasad Mujumdar added a comment -

          hmm .. I can reproduce this when the session is idle for a short while. The SSL server transport is getting created with a hardcoded client read timeout which I guess is causing this.
          Ideally this should be configurable. I will test it and submit a patch. Thanks!

          Show
          Prasad Mujumdar added a comment - hmm .. I can reproduce this when the session is idle for a short while. The SSL server transport is getting created with a hardcoded client read timeout which I guess is causing this. Ideally this should be configurable. I will test it and submit a patch. Thanks!
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar Actually we're setting the loginTimeout to 0. TSSLTransportFactory#createClient internally calls socket.setSoTimeout(0). Per the docs, a timeout of 0 is interpreted as infinite timeout. Let me also investigate more...

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar Actually we're setting the loginTimeout to 0. TSSLTransportFactory#createClient internally calls socket.setSoTimeout(0). Per the docs, a timeout of 0 is interpreted as infinite timeout. Let me also investigate more...
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar Let me check the server transport too. Client looks fine.

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar Let me check the server transport too. Client looks fine.
          Hide
          Prasad Mujumdar added a comment -

          no, It's the timeout on server socket

          Show
          Prasad Mujumdar added a comment - no, It's the timeout on server socket
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar Oops, clicked on assign to me by mistake.

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar Oops, clicked on assign to me by mistake.
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar If you set it to 0, should fix the issue.

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar If you set it to 0, should fix the issue.
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar Just tested, that fixes it. I think we should have this in 13. Will make this blocker. Thanks!

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar Just tested, that fixes it. I think we should have this in 13. Will make this blocker. Thanks!
          Hide
          Prasad Mujumdar added a comment -

          yes, That's what I tested.
          As I mentioned before, it would be good to make it configurable. We did support the server side read timeout as well as keep-alive in the old hiveserver. For HiveServer2, now we have multiple connection options, Kerberos, Delegation Token (Digest-MD5), Plain Sasl with and without SSL and raw sockets. The configuration should be applicable to all flavors.

          I will submit the short term fix to the server timeout to 0 which can go into 0.13 and log a followup ticket to make it configurable of 0.14.

          Show
          Prasad Mujumdar added a comment - yes, That's what I tested. As I mentioned before, it would be good to make it configurable. We did support the server side read timeout as well as keep-alive in the old hiveserver. For HiveServer2, now we have multiple connection options, Kerberos, Delegation Token (Digest-MD5), Plain Sasl with and without SSL and raw sockets. The configuration should be applicable to all flavors. I will submit the short term fix to the server timeout to 0 which can go into 0.13 and log a followup ticket to make it configurable of 0.14.
          Hide
          Vaibhav Gumashta added a comment -

          Prasad Mujumdar I agree. Yeah, short term for 13 sounds good!

          Show
          Vaibhav Gumashta added a comment - Prasad Mujumdar I agree. Yeah, short term for 13 sounds good!
          Hide
          Prasad Mujumdar added a comment -

          The SSL Server socket is created with a hardcoded timeout. This is inconsistent with rest of the server transport types.
          The patch sets it to infinite timeout.

          I will create a followup ticket to make the timeout configurable for all transport types.

          Show
          Prasad Mujumdar added a comment - The SSL Server socket is created with a hardcoded timeout. This is inconsistent with rest of the server transport types. The patch sets it to infinite timeout. I will create a followup ticket to make the timeout configurable for all transport types.
          Hide
          Vaibhav Gumashta added a comment -

          +1 (non-binding).

          Show
          Vaibhav Gumashta added a comment - +1 (non-binding).
          Hide
          Hive QA added a comment -

          Overall: -1 no tests executed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12634882/HIVE-6660.1.patch

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1827/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1827/console

          Messages:

          **** This message was trimmed, see log for full details ****
          [INFO] Using 'UTF-8' encoding to copy filtered resources.
          [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hwi/src/test/resources
          [INFO] Copying 3 resources
          [INFO] 
          [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-hwi ---
          [INFO] Executing tasks
          
          main:
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/warehouse
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf
               [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf
          [INFO] Executed tasks
          [INFO] 
          [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-hwi ---
          [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/test-classes
          [INFO] 
          [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-hwi ---
          [INFO] Tests are skipped.
          [INFO] 
          [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-hwi ---
          [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar
          [INFO] 
          [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-hwi ---
          [INFO] 
          [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-hwi ---
          [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.jar
          [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.pom
          [INFO]                                                                         
          [INFO] ------------------------------------------------------------------------
          [INFO] Building Hive ODBC 0.14.0-SNAPSHOT
          [INFO] ------------------------------------------------------------------------
          [INFO] 
          [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-odbc ---
          [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/odbc (includes = [datanucleus.log, derby.log], excludes = [])
          [INFO] 
          [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-odbc ---
          [INFO] 
          [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-odbc ---
          [INFO] Executing tasks
          
          main:
          [INFO] Executed tasks
          [INFO] 
          [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-odbc ---
          [INFO] Executing tasks
          
          main:
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/warehouse
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf
               [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf
          [INFO] Executed tasks
          [INFO] 
          [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-odbc ---
          [INFO] 
          [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-odbc ---
          [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/odbc/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-odbc/0.14.0-SNAPSHOT/hive-odbc-0.14.0-SNAPSHOT.pom
          [INFO]                                                                         
          [INFO] ------------------------------------------------------------------------
          [INFO] Building Hive Shims Aggregator 0.14.0-SNAPSHOT
          [INFO] ------------------------------------------------------------------------
          [INFO] 
          [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-aggregator ---
          [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/shims (includes = [datanucleus.log, derby.log], excludes = [])
          [INFO] 
          [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-shims-aggregator ---
          [INFO] 
          [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-shims-aggregator ---
          [INFO] Executing tasks
          
          main:
          [INFO] Executed tasks
          [INFO] 
          [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-shims-aggregator ---
          [INFO] Executing tasks
          
          main:
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/warehouse
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf
               [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf
          [INFO] Executed tasks
          [INFO] 
          [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-shims-aggregator ---
          [INFO] 
          [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-shims-aggregator ---
          [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/shims/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-shims-aggregator/0.14.0-SNAPSHOT/hive-shims-aggregator-0.14.0-SNAPSHOT.pom
          [INFO]                                                                         
          [INFO] ------------------------------------------------------------------------
          [INFO] Building Hive TestUtils 0.14.0-SNAPSHOT
          [INFO] ------------------------------------------------------------------------
          [INFO] 
          [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-testutils ---
          [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/testutils (includes = [datanucleus.log, derby.log], excludes = [])
          [INFO] 
          [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-testutils ---
          [INFO] 
          [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-testutils ---
          [INFO] Using 'UTF-8' encoding to copy filtered resources.
          [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/main/resources
          [INFO] Copying 3 resources
          [INFO] 
          [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-testutils ---
          [INFO] Executing tasks
          
          main:
          [INFO] Executed tasks
          [INFO] 
          [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-testutils ---
          [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/classes
          [INFO] 
          [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-testutils ---
          [INFO] Using 'UTF-8' encoding to copy filtered resources.
          [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/test/resources
          [INFO] Copying 3 resources
          [INFO] 
          [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-testutils ---
          [INFO] Executing tasks
          
          main:
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/warehouse
              [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf
               [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf
          [INFO] Executed tasks
          [INFO] 
          [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-testutils ---
          [INFO] No sources to compile
          [INFO] 
          [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-testutils ---
          [INFO] Tests are skipped.
          [INFO] 
          [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-testutils ---
          [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar
          [INFO] 
          [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-testutils ---
          [INFO] 
          [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-testutils ---
          [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.jar
          [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.pom
          [INFO]                                                                         
          [INFO] ------------------------------------------------------------------------
          [INFO] Building Hive Packaging 0.14.0-SNAPSHOT
          [INFO] ------------------------------------------------------------------------
          Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/maven-metadata.xml
          Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.pom
          [WARNING] The POM for org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT is missing, no dependency information available
          Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.jar
          [INFO] ------------------------------------------------------------------------
          [INFO] Reactor Summary:
          [INFO] 
          [INFO] Hive .............................................. SUCCESS [8.386s]
          [INFO] Hive Ant Utilities ................................ SUCCESS [6.096s]
          [INFO] Hive Shims Common ................................. SUCCESS [3.638s]
          [INFO] Hive Shims 0.20 ................................... SUCCESS [2.442s]
          [INFO] Hive Shims Secure Common .......................... SUCCESS [4.415s]
          [INFO] Hive Shims 0.20S .................................. SUCCESS [2.639s]
          [INFO] Hive Shims 0.23 ................................... SUCCESS [8.021s]
          [INFO] Hive Shims ........................................ SUCCESS [1.249s]
          [INFO] Hive Common ....................................... SUCCESS [6.847s]
          [INFO] Hive Serde ........................................ SUCCESS [10.164s]
          [INFO] Hive Metastore .................................... SUCCESS [32.077s]
          [INFO] Hive Query Language ............................... SUCCESS [1:15.619s]
          [INFO] Hive Service ...................................... SUCCESS [7.847s]
          [INFO] Hive JDBC ......................................... SUCCESS [2.907s]
          [INFO] Hive Beeline ...................................... SUCCESS [2.583s]
          [INFO] Hive CLI .......................................... SUCCESS [1.955s]
          [INFO] Hive Contrib ...................................... SUCCESS [2.457s]
          [INFO] Hive HBase Handler ................................ SUCCESS [2.609s]
          [INFO] Hive HCatalog ..................................... SUCCESS [0.538s]
          [INFO] Hive HCatalog Core ................................ SUCCESS [1.921s]
          [INFO] Hive HCatalog Pig Adapter ......................... SUCCESS [2.534s]
          [INFO] Hive HCatalog Server Extensions ................... SUCCESS [1.283s]
          [INFO] Hive HCatalog Webhcat Java Client ................. SUCCESS [2.122s]
          [INFO] Hive HCatalog Webhcat ............................. SUCCESS [9.937s]
          [INFO] Hive HWI .......................................... SUCCESS [1.058s]
          [INFO] Hive ODBC ......................................... SUCCESS [0.811s]
          [INFO] Hive Shims Aggregator ............................. SUCCESS [0.217s]
          [INFO] Hive TestUtils .................................... SUCCESS [0.661s]
          [INFO] Hive Packaging .................................... FAILURE [1.885s]
          [INFO] ------------------------------------------------------------------------
          [INFO] BUILD FAILURE
          [INFO] ------------------------------------------------------------------------
          [INFO] Total time: 3:29.422s
          [INFO] Finished at: Sat Mar 15 06:48:00 EDT 2014
          [INFO] Final Memory: 74M/381M
          [INFO] ------------------------------------------------------------------------
          [ERROR] Failed to execute goal on project hive-packaging: Could not resolve dependencies for project org.apache.hive:hive-packaging:pom:0.14.0-SNAPSHOT: Could not find artifact org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1]
          [ERROR] 
          [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
          [ERROR] Re-run Maven using the -X switch to enable full debug logging.
          [ERROR] 
          [ERROR] For more information about the errors and possible solutions, please read the following articles:
          [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
          [ERROR] 
          [ERROR] After correcting the problems, you can resume the build with the command
          [ERROR]   mvn <goals> -rf :hive-packaging
          + exit 1
          '
          

          This message is automatically generated.

          ATTACHMENT ID: 12634882

          Show
          Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12634882/HIVE-6660.1.patch Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1827/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1827/console Messages: **** This message was trimmed, see log for full details **** [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hwi/src/test/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-hwi --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-hwi --- [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-hwi --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-hwi --- [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-hwi --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-hwi --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.jar [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive ODBC 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-odbc --- [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/odbc (includes = [datanucleus.log, derby.log], excludes = []) [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-odbc --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-odbc --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-odbc --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-odbc --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-odbc --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/odbc/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-odbc/0.14.0-SNAPSHOT/hive-odbc-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive Shims Aggregator 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-aggregator --- [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/shims (includes = [datanucleus.log, derby.log], excludes = []) [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-shims-aggregator --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-shims-aggregator --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-shims-aggregator --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-shims-aggregator --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-shims-aggregator --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/shims/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-shims-aggregator/0.14.0-SNAPSHOT/hive-shims-aggregator-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive TestUtils 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-testutils --- [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/testutils (includes = [datanucleus.log, derby.log], excludes = []) [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-testutils --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-testutils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/main/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-testutils --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-testutils --- [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-testutils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/test/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-testutils --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-testutils --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-testutils --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-testutils --- [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-testutils --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-testutils --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.jar [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive Packaging 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/maven-metadata.xml Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.pom [WARNING] The POM for org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT is missing, no dependency information available Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.jar [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Hive .............................................. SUCCESS [8.386s] [INFO] Hive Ant Utilities ................................ SUCCESS [6.096s] [INFO] Hive Shims Common ................................. SUCCESS [3.638s] [INFO] Hive Shims 0.20 ................................... SUCCESS [2.442s] [INFO] Hive Shims Secure Common .......................... SUCCESS [4.415s] [INFO] Hive Shims 0.20S .................................. SUCCESS [2.639s] [INFO] Hive Shims 0.23 ................................... SUCCESS [8.021s] [INFO] Hive Shims ........................................ SUCCESS [1.249s] [INFO] Hive Common ....................................... SUCCESS [6.847s] [INFO] Hive Serde ........................................ SUCCESS [10.164s] [INFO] Hive Metastore .................................... SUCCESS [32.077s] [INFO] Hive Query Language ............................... SUCCESS [1:15.619s] [INFO] Hive Service ...................................... SUCCESS [7.847s] [INFO] Hive JDBC ......................................... SUCCESS [2.907s] [INFO] Hive Beeline ...................................... SUCCESS [2.583s] [INFO] Hive CLI .......................................... SUCCESS [1.955s] [INFO] Hive Contrib ...................................... SUCCESS [2.457s] [INFO] Hive HBase Handler ................................ SUCCESS [2.609s] [INFO] Hive HCatalog ..................................... SUCCESS [0.538s] [INFO] Hive HCatalog Core ................................ SUCCESS [1.921s] [INFO] Hive HCatalog Pig Adapter ......................... SUCCESS [2.534s] [INFO] Hive HCatalog Server Extensions ................... SUCCESS [1.283s] [INFO] Hive HCatalog Webhcat Java Client ................. SUCCESS [2.122s] [INFO] Hive HCatalog Webhcat ............................. SUCCESS [9.937s] [INFO] Hive HWI .......................................... SUCCESS [1.058s] [INFO] Hive ODBC ......................................... SUCCESS [0.811s] [INFO] Hive Shims Aggregator ............................. SUCCESS [0.217s] [INFO] Hive TestUtils .................................... SUCCESS [0.661s] [INFO] Hive Packaging .................................... FAILURE [1.885s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 3:29.422s [INFO] Finished at: Sat Mar 15 06:48:00 EDT 2014 [INFO] Final Memory: 74M/381M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project hive-packaging: Could not resolve dependencies for project org.apache.hive:hive-packaging:pom:0.14.0-SNAPSHOT: Could not find artifact org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hive-packaging + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12634882
          Hide
          Prasad Mujumdar added a comment -

          re-attaching for pre-commit run

          Show
          Prasad Mujumdar added a comment - re-attaching for pre-commit run
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12634989/HIVE-6660.1.patch

          ERROR: -1 due to 2 failed/errored test(s), 5406 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority2
          

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1856/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1856/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12634989

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12634989/HIVE-6660.1.patch ERROR: -1 due to 2 failed/errored test(s), 5406 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority2 Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1856/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1856/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12634989
          Hide
          Prasad Mujumdar added a comment -

          The failures look unrelated.

          Show
          Prasad Mujumdar added a comment - The failures look unrelated.
          Hide
          Thejas M Nair added a comment -

          +1

          Show
          Thejas M Nair added a comment - +1
          Hide
          Prasad Mujumdar added a comment -

          Patch committed to trunk.

          Harish Butani This should be a blocker for hive 0.13. Requesting approval to push the patch to 0.13 release branch.

          Show
          Prasad Mujumdar added a comment - Patch committed to trunk. Harish Butani This should be a blocker for hive 0.13. Requesting approval to push the patch to 0.13 release branch.
          Hide
          Harish Butani added a comment -

          +1 for porting to 0.13 branch

          Show
          Harish Butani added a comment - +1 for porting to 0.13 branch
          Hide
          Prasad Mujumdar added a comment -

          Patch committed to trunk and 0.13 release branch.
          Thanks Thejas and Vaibhav for review

          Show
          Prasad Mujumdar added a comment - Patch committed to trunk and 0.13 release branch. Thanks Thejas and Vaibhav for review

            People

            • Assignee:
              Prasad Mujumdar
              Reporter:
              Vaibhav Gumashta
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development