Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5379

TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: test, timelineserver
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The TestHBaseTimelineStorage. testWriteApplicationToHBase() test seems to fail intermittently:

      java.lang.AssertionError: null
      	at org.junit.Assert.fail(Assert.java:86)
      	at org.junit.Assert.assertTrue(Assert.java:41)
      	at org.junit.Assert.assertTrue(Assert.java:52)
      	at org.apache.hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage.testWriteApplicationToHBase(TestHBaseTimelineStorage.java:817)
      

      The stdout output:

      2016-07-13 00:15:48,883 INFO  [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x2b7962a2 connecting to ZooKeeper ensemble=localhost:53474
      2016-07-13 00:15:48,883 INFO  [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x2b7962a20x0, quorum=localhost:53474, baseZNode=/hbase
      2016-07-13 00:15:48,886 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error)
      2016-07-13 00:15:48,887 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session
      2016-07-13 00:15:48,887 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38097
      2016-07-13 00:15:48,887 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38097
      2016-07-13 00:15:48,896 INFO  [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520025 with negotiated timeout 40000 for client /127.0.0.1:38097
      2016-07-13 00:15:48,896 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520025, negotiated timeout = 40000
      2016-07-13 00:15:48,911 INFO  [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x32130e61 connecting to ZooKeeper ensemble=localhost:53474
      2016-07-13 00:15:48,912 INFO  [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x32130e610x0, quorum=localhost:53474, baseZNode=/hbase
      2016-07-13 00:15:48,917 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error)
      2016-07-13 00:15:48,918 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38098
      2016-07-13 00:15:48,921 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session
      2016-07-13 00:15:48,921 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38098
      2016-07-13 00:15:48,929 INFO  [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520026 with negotiated timeout 40000 for client /127.0.0.1:38098
      2016-07-13 00:15:48,929 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520026, negotiated timeout = 40000
      2016-07-13 00:15:48,938 INFO  [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(541)) - closing the entity table
      2016-07-13 00:15:48,938 INFO  [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(546)) - closing the app_flow table
      2016-07-13 00:15:48,938 INFO  [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(551)) - closing the application table
      2016-07-13 00:15:48,941 INFO  [RpcServer.reader=1,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35467 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3"
      2016-07-13 00:15:48,950 INFO  [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(555)) - closing the flow run table
      2016-07-13 00:15:48,957 INFO  [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(560)) - closing the flowActivityTable table
      2016-07-13 00:15:48,957 INFO  [main] storage.HBaseTimelineWriterImpl (HBaseTimelineWriterImpl.java:serviceStop(565)) - closing the hbase Connection
      2016-07-13 00:15:48,958 INFO  [main] client.ConnectionManager$HConnectionImplementation (ConnectionManager.java:closeZooKeeperWatcher(1677)) - Closing zookeeper sessionid=0x155e19baa520026
      2016-07-13 00:15:48,958 INFO  [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest2Txn(494)) - Processed session termination for sessionid: 0x155e19baa520026
      2016-07-13 00:15:48,968 INFO  [main] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x155e19baa520026 closed
      2016-07-13 00:15:48,968 INFO  [main-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down
      2016-07-13 00:15:48,968 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1007)) - Closed socket connection for client /127.0.0.1:38098 which had sessionid 0x155e19baa520026
      2016-07-13 00:15:48,979 INFO  [main] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=hconnection-0x4596f8f3 connecting to ZooKeeper ensemble=localhost:53474
      2016-07-13 00:15:48,979 INFO  [main] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=localhost:53474 sessionTimeout=90000 watcher=hconnection-0x4596f8f30x0, quorum=localhost:53474, baseZNode=/hbase
      2016-07-13 00:15:48,980 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server localhost/127.0.0.1:53474. Will not attempt to authenticate using SASL (unknown error)
      2016-07-13 00:15:48,981 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to localhost/127.0.0.1:53474, initiating session
      2016-07-13 00:15:48,981 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxnFactory (NIOServerCnxnFactory.java:run(197)) - Accepted socket connection from /127.0.0.1:38100
      2016-07-13 00:15:48,981 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.ZooKeeperServer (ZooKeeperServer.java:processConnectRequest(868)) - Client attempting to establish new session at /127.0.0.1:38100
      2016-07-13 00:15:48,987 INFO  [SyncThread:0] server.ZooKeeperServer (ZooKeeperServer.java:finishSessionInit(617)) - Established session 0x155e19baa520027 with negotiated timeout 40000 for client /127.0.0.1:38100
      2016-07-13 00:15:48,988 INFO  [main-SendThread(localhost:53474)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server localhost/127.0.0.1:53474, sessionid = 0x155e19baa520027, negotiated timeout = 40000
      2016-07-13 00:15:48,992 INFO  [RpcServer.reader=2,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35470 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3"
      2016-07-13 00:15:49,001 INFO  [RpcServer.reader=3,bindAddress=2588a1932efe,port=37493] hbase.Server (RpcServer.java:processConnectionHeader(1678)) - Connection from 172.17.0.3 port: 35472 with version info: version: "1.1.3" url: "git://diocles.local/Volumes/hbase-1.1.3RC1/hbase" revision: "72bc50f5fafeb105b2139e42bbee3d61ca724989" user: "ndimiduk" date: "Sat Jan 16 18:31:39 PST 2016" src_checksum: "72c910d76fba182fa4e3c7e048275ca3"
      2016-07-13 00:15:49,010 INFO  [main] storage.HBaseTimelineReaderImpl (HBaseTimelineReaderImpl.java:serviceStop(64)) - closing the hbase Connection
      2016-07-13 00:15:49,010 INFO  [main] client.ConnectionManager$HConnectionImplementation (ConnectionManager.java:closeZooKeeperWatcher(1677)) - Closing zookeeper sessionid=0x155e19baa520025
      2016-07-13 00:15:49,011 INFO  [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor (PrepRequestProcessor.java:pRequest2Txn(494)) - Processed session termination for sessionid: 0x155e19baa520025
      2016-07-13 00:15:49,021 INFO  [main] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x155e19baa520025 closed
      2016-07-13 00:15:49,021 INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:53474] server.NIOServerCnxn (NIOServerCnxn.java:closeSock(1007)) - Closed socket connection for client /127.0.0.1:38097 which had sessionid 0x155e19baa520025
      2016-07-13 00:15:49,021 INFO  [main-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down
      

        Attachments

        1. YARN-5379.01.patch
          2 kB
          Sangjin Lee
        2. YARN-5379-YARN-5355.01.patch
          2 kB
          Vrushali C

          Activity

            People

            • Assignee:
              vrushalic Vrushali C
              Reporter:
              sjlee0 Sangjin Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: