[ATLAS-885] optimize HBaseStoreManager to avoid expensive HTable instantiation every 5 seconds

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7-incubating
• Assignee: Madhan Neethiraj
• Reporter: Madhan Neethiraj
• Created: 09/Jun/16 00:18
• Updated: 09/Jun/16 11:11
• Resolved: 09/Jun/16 11:11

Description

For every 5 seconds following logs are added to /var/logs/atlas/application.log, which increases the log file size unnecessarily and makes the log difficult to use.

2016-05-17 22:01:18,528 INFO - [pool-5-thread-1:] ~ Process identifier=hconnection-0x7878431f connecting to ZooKeeper ensemble=localhost:2181 (RecoverableZooKeeper:120)
2016-05-17 22:01:18,528 INFO - [pool-5-thread-1:] ~ Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@78b60e6a (ZooKeeper:438)
2016-05-17 22:01:18,529 INFO - pool-5-thread-1-SendThread(localhost.localdomain:2181): ~ Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (ClientCnxn:1019)
2016-05-17 22:01:18,529 INFO - pool-5-thread-1-SendThread(localhost.localdomain:2181): ~ Socket connection established to localhost.localdomain/127.0.0.1:2181, initiating session (ClientCnxn:864)
2016-05-17 22:01:18,531 INFO - pool-5-thread-1-SendThread(localhost.localdomain:2181): ~ Session establishment complete on server localhost.localdomain/127.0.0.1:2181, sessionid = 0x154c1cf558e18b9, negotiated timeout = 40000 (ClientCnxn:1279)
2016-05-17 22:01:18,539 INFO - [pool-5-thread-1:] ~ Closing zookeeper sessionid=0x154c1cf558e18b9 (ConnectionManager$HConnectionImplementation:1684)
2016-05-17 22:01:18,540 INFO - [pool-5-thread-1:] ~ Session: 0x154c1cf558e18b9 closed (ZooKeeper:684)
2016-05-17 22:01:18,540 INFO - [pool-5-thread-1-EventThread:] ~ EventThread shut down (ClientCnxn:524)

Issue Links

• links to: Review board for the patch