Wed Aug 20 19:51:28 UTC 2014 Starting master on hor17n36.gq1.ygridcore.net core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 192989 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 32768 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 4096 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2014-08-20 19:51:29,519 INFO [main] util.VersionInfo: HBase 2.0.0-SNAPSHOT 2014-08-20 19:51:29,519 INFO [main] util.VersionInfo: Subversion git://soleil.local/Users/ndimiduk/repos/hbase -r 74f957aa2841d7765920fda110ebdf8739809c39 2014-08-20 19:51:29,519 INFO [main] util.VersionInfo: Compiled by ndimiduk on Wed Aug 20 12:42:01 PDT 2014 2014-08-20 19:51:29,712 WARN [main] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:29,740 INFO [main] util.ServerCommandLine: env:TERM=screen-256color 2014-08-20 19:51:29,740 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/jdk64/jdk1.7.0_45 2014-08-20 19:51:29,740 INFO [main] util.ServerCommandLine: env:SHLVL=3 2014-08-20 19:51:29,740 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/var/log/hbase 2014-08-20 19:51:29,740 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/lib/hbase/bin/.. 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-XX:+UseConcMarkSweepGC -XX:ErrorFile=/grid/0/var/log/hbase/hs_err_pid%p.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/var/log/hbase/gc.log-201408201951 -Xmx20480m -ea -Dhbase.log.dir=/grid/0/var/log/hbase -Dhbase.log.file=hbase-hbase-master-hor17n36.gq1.ygridcore.net.log -Dhbase.home.dir=/usr/lib/hbase/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/lib/hadoop/lib/native/Linux-amd64-64:/usr/lib/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:HOSTNAME=hor17n36.gq1.ygridcore.net 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/grid/0/var/run/hbase/hbase-hbase-master.znode 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:PWD=/home/hbase 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS=-Xmx20480m -ea 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/etc/hbase/conf 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:CVS_RSH=ssh 2014-08-20 19:51:29,741 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:G_BROKEN_FILENAMES=1 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/lib/hadoop/lib/native/Linux-amd64-64:/usr/lib/hadoop/lib/native 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/grid/0/var/run/hbase 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS=-Xmn200m -XX:CMSInitiatingOccupancyFraction=70 -Xms1024m -Xmx1024m -ea 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2014-08-20 19:51:29,742 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2014-08-20 19:51:29,744 INFO [main] util.ServerCommandLine: env:CLASSPATH=/etc/hbase/conf:/usr/jdk64/jdk1.7.0_45/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/aopalliance-1.0.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.7.4.jar:/usr/lib/hbase/bin/../lib/commons-beanutils-1.7.0.jar:/usr/lib/hbase/bin/../lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.7.jar:/usr/lib/hbase/bin/../lib/commons-collections-3.2.1.jar:/usr/lib/hbase/bin/../lib/commons-compress-1.4.1.jar:/usr/lib/hbase/bin/../lib/commons-configuration-1.6.jar:/usr/lib/hbase/bin/../lib/commons-daemon-1.0.13.jar:/usr/lib/hbase/bin/../lib/commons-digester-1.8.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-io-2.4.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.6.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.3.jar:/usr/lib/hbase/bin/../lib/commons-math-2.1.jar:/usr/lib/hbase/bin/../lib/commons-math3-3.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-3.1.jar:/usr/lib/hbase/bin/../lib/disruptor-3.2.0.jar:/usr/lib/hbase/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/lib/hbase/bin/../lib/guava-12.0.1.jar:/usr/lib/hbase/bin/../lib/guice-3.0.jar:/usr/lib/hbase/bin/../lib/guice-servlet-3.0.jar:/usr/lib/hbase/bin/../lib/hadoop-annotations-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-auth-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-client-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-hdfs-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-app-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-core-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-jobclient-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-shuffle-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-api-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-client-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-server-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-server-nodemanager-2.4.0.jar:/usr/lib/hbase/bin/../lib/hamcrest-core-1.3.jar:/usr/lib/hbase/bin/../lib/hbase-client-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-common-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-common-2.0.0-SNAPSHOT-tests.jar:/usr/lib/hbase/bin/../lib/hbase-examples-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-hadoop2-compat-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-it-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-it-2.0.0-SNAPSHOT-tests.jar:/usr/lib/hbase/bin/../lib/hbase-prefix-tree-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-protocol-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-server-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-server-2.0.0-SNAPSHOT-tests.jar:/usr/lib/hbase/bin/../lib/hbase-shell-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-testing-util-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-thrift-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/htrace-core-3.0.4.jar:/usr/lib/hbase/bin/../lib/httpclient-4.2.5.jar:/usr/lib/hbase/bin/../lib/httpcore-4.1.3.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.8.8.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.8.8.jar:/usr/lib/hbase/bin/../lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/javax.inject-1.jar:/usr/lib/hbase/bin/../lib/java-xmlbuilder-0.4.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.2.2.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hbase/bin/../lib/jersey-client-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-guice-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.9.jar:/usr/lib/hbase/bin/../lib/jets3t-0.9.0.jar:/usr/lib/hbase/bin/../lib/jettison-1.3.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-sslengine-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.6.8.jar:/usr/lib/hbase/bin/../lib/jsch-0.1.42.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsr305-1.3.9.jar:/usr/lib/hbase/bin/../lib/junit-4.11.jar:/usr/lib/hbase/bin/../lib/libthrift-0.9.0.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.17.jar:/usr/lib/hbase/bin/../lib/metrics-core-2.2.0.jar:/usr/lib/hbase/bin/../lib/netty-3.2.4.Final.jar:/usr/lib/hbase/bin/../lib/netty-all-4.0.19.Final.jar:/usr/lib/hbase/bin/../lib/paranamer-2.3.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.5.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.7.5.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.7.5.jar:/usr/lib/hbase/bin/../lib/snappy-java-1.0.4.1.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/xz-1.0.jar:/usr/lib/hbase/bin/../lib/zookeeper-3.4.6.jar:/etc/hadoop/conf:/usr/lib/hadoop/lib/*:/usr/lib/hadoop/.//*:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-hdfs/.//*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-mapreduce/.//*::/usr/lib/hadoop-mapreduce/* 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:PATH=/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hbase/bin 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:USER=hbase 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/etc/hbase/conf/regionservers 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HOME=/home/hbase 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH= 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:LESSOPEN=|/usr/bin/lesspipe.sh %s 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HBASE_START_FILE=/grid/0/var/run/hbase/hbase-hbase-master.autorestart 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/var/log/hbase/gc.log-201408201951 2014-08-20 19:51:29,745 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-master-hor17n36.gq1.ygridcore.net.log 2014-08-20 19:51:29,746 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2014-08-20 19:51:29,746 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-master-hor17n36.gq1.ygridcore.net 2014-08-20 19:51:29,746 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2014-08-20 19:51:29,751 INFO [main] util.ServerCommandLine: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=24.45-b08 2014-08-20 19:51:29,751 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_master, -XX:OnOutOfMemoryError=kill -9 %p, -Xmx1000m, -XX:+UseConcMarkSweepGC, -XX:ErrorFile=/grid/0/var/log/hbase/hs_err_pid%p.log, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/var/log/hbase/gc.log-201408201951, -Xmx20480m, -ea, -Dhbase.log.dir=/grid/0/var/log/hbase, -Dhbase.log.file=hbase-hbase-master-hor17n36.gq1.ygridcore.net.log, -Dhbase.home.dir=/usr/lib/hbase/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/lib/hadoop/lib/native/Linux-amd64-64:/usr/lib/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2014-08-20 19:51:30,102 INFO [main] regionserver.RSRpcServices: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020 server-side HConnection retries=350 2014-08-20 19:51:30,276 INFO [main] ipc.SimpleRpcScheduler: Using deadline as user call queue, count=6 2014-08-20 19:51:30,295 INFO [main] ipc.RpcServer: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020: started 10 reader(s). 2014-08-20 19:51:30,393 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2014-08-20 19:51:30,409 WARN [main] impl.MetricsSystemImpl: Error creating sink 'ganglia' org.apache.hadoop.metrics2.impl.MetricsConfigException: Error creating plugin: org.apache.hadoop.metrics2.sink.ganglia.GangliaSink31 at org.apache.hadoop.metrics2.impl.MetricsConfig.getPlugin(MetricsConfig.java:202) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.newSink(MetricsSystemImpl.java:496) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.configureSinks(MetricsSystemImpl.java:468) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.configure(MetricsSystemImpl.java:447) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.start(MetricsSystemImpl.java:180) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:156) at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:54) at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50) at org.apache.hadoop.hbase.metrics.BaseSourceImpl$DefaultMetricsSystemInitializer.init(BaseSourceImpl.java:50) at org.apache.hadoop.hbase.metrics.BaseSourceImpl.(BaseSourceImpl.java:74) at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.(MetricsHBaseServerSourceImpl.java:49) at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48) at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38) at org.apache.hadoop.hbase.ipc.MetricsHBaseServer.(MetricsHBaseServer.java:30) at org.apache.hadoop.hbase.ipc.RpcServer.(RpcServer.java:1886) at org.apache.hadoop.hbase.regionserver.RSRpcServices.(RSRpcServices.java:733) at org.apache.hadoop.hbase.master.MasterRpcServices.(MasterRpcServices.java:196) at org.apache.hadoop.hbase.master.HMaster.createRpcServices(HMaster.java:368) at org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:464) at org.apache.hadoop.hbase.master.HMaster.(HMaster.java:265) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1776) at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:194) at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126) at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1795) Caused by: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: :8663 at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:211) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:163) at org.apache.hadoop.metrics2.util.Servers.parse(Servers.java:61) at org.apache.hadoop.metrics2.sink.ganglia.AbstractGangliaSink.init(AbstractGangliaSink.java:132) at org.apache.hadoop.metrics2.sink.ganglia.GangliaSink30.init(GangliaSink30.java:59) at org.apache.hadoop.metrics2.impl.MetricsConfig.getPlugin(MetricsConfig.java:198) ... 29 more 2014-08-20 19:51:30,594 INFO [main] impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2014-08-20 19:51:30,594 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2014-08-20 19:51:30,802 INFO [main] hfile.CacheConfig: Allocating LruBlockCache size=11.94 GB, blockSize=64 KB 2014-08-20 19:51:30,817 INFO [main] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=13143568, freeSize=12803731952, maxSize=12816875520, heapSize=13143568, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:31,437 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=hor17n36.gq1.ygridcore.net 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.7.0_45 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/jdk64/jdk1.7.0_45/jre 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/etc/hbase/conf:/usr/jdk64/jdk1.7.0_45/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/aopalliance-1.0.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.7.4.jar:/usr/lib/hbase/bin/../lib/commons-beanutils-1.7.0.jar:/usr/lib/hbase/bin/../lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.7.jar:/usr/lib/hbase/bin/../lib/commons-collections-3.2.1.jar:/usr/lib/hbase/bin/../lib/commons-compress-1.4.1.jar:/usr/lib/hbase/bin/../lib/commons-configuration-1.6.jar:/usr/lib/hbase/bin/../lib/commons-daemon-1.0.13.jar:/usr/lib/hbase/bin/../lib/commons-digester-1.8.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-io-2.4.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.6.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.3.jar:/usr/lib/hbase/bin/../lib/commons-math-2.1.jar:/usr/lib/hbase/bin/../lib/commons-math3-3.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-3.1.jar:/usr/lib/hbase/bin/../lib/disruptor-3.2.0.jar:/usr/lib/hbase/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/lib/hbase/bin/../lib/guava-12.0.1.jar:/usr/lib/hbase/bin/../lib/guice-3.0.jar:/usr/lib/hbase/bin/../lib/guice-servlet-3.0.jar:/usr/lib/hbase/bin/../lib/hadoop-annotations-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-auth-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-client-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-hdfs-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-app-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-core-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-jobclient-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-mapreduce-client-shuffle-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-api-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-client-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-server-common-2.4.0.jar:/usr/lib/hbase/bin/../lib/hadoop-yarn-server-nodemanager-2.4.0.jar:/usr/lib/hbase/bin/../lib/hamcrest-core-1.3.jar:/usr/lib/hbase/bin/../lib/hbase-client-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-common-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-common-2.0.0-SNAPSHOT-tests.jar:/usr/lib/hbase/bin/../lib/hbase-examples-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-hadoop2-compat-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-hadoop-compat-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-it-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-it-2.0.0-SNAPSHOT-tests.jar:/usr/lib/hbase/bin/../lib/hbase-prefix-tree-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-protocol-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-server-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-server-2.0.0-SNAPSHOT-tests.jar:/usr/lib/hbase/bin/../lib/hbase-shell-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-testing-util-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/hbase-thrift-2.0.0-SNAPSHOT.jar:/usr/lib/hbase/bin/../lib/htrace-core-3.0.4.jar:/usr/lib/hbase/bin/../lib/httpclient-4.2.5.jar:/usr/lib/hbase/bin/../lib/httpcore-4.1.3.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.8.8.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.8.8.jar:/usr/lib/hbase/bin/../lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/javax.inject-1.jar:/usr/lib/hbase/bin/../lib/java-xmlbuilder-0.4.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.2.2.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hbase/bin/../lib/jersey-client-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-guice-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.9.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.9.jar:/usr/lib/hbase/bin/../lib/jets3t-0.9.0.jar:/usr/lib/hbase/bin/../lib/jettison-1.3.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-sslengine-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.6.8.jar:/usr/lib/hbase/bin/../lib/jsch-0.1.42.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsr305-1.3.9.jar:/usr/lib/hbase/bin/../lib/junit-4.11.jar:/usr/lib/hbase/bin/../lib/libthrift-0.9.0.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.17.jar:/usr/lib/hbase/bin/../lib/metrics-core-2.2.0.jar:/usr/lib/hbase/bin/../lib/netty-3.2.4.Final.jar:/usr/lib/hbase/bin/../lib/netty-all-4.0.19.Final.jar:/usr/lib/hbase/bin/../lib/paranamer-2.3.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.5.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.7.5.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.7.5.jar:/usr/lib/hbase/bin/../lib/snappy-java-1.0.4.1.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/xz-1.0.jar:/usr/lib/hbase/bin/../lib/zookeeper-3.4.6.jar:/etc/hadoop/conf:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/jets3t-0.9.0.jar:/usr/lib/hadoop/lib/postgresql-9.1-901-1.jdbc4.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/avro-1.7.4.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop/lib/jersey-json-1.9.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.5.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/zookeeper-3.4.5.2.1.3.0-563.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/stax-api-1.0-2.jar:/usr/lib/hadoop/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar:/usr/lib/hadoop/lib/commons-io-2.4.jar:/usr/lib/hadoop/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/lib/hadoop/lib/commons-lang-2.6.jar:/usr/lib/hadoop/lib/jersey-server-1.9.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/jersey-core-1.9.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/hadoop-lzo-0.6.0.jar:/usr/lib/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop/lib/slf4j-api-1.7.5.jar:/usr/lib/hadoop/lib/jackson-core-2.2.3.jar:/usr/lib/hadoop/lib/httpclient-4.2.5.jar:/usr/lib/hadoop/lib/jsr305-1.3.9.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/xz-1.0.jar:/usr/lib/hadoop/lib/ambari-log4j-1.6.1.98.jar:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/junit-4.8.2.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/lib/httpcore-4.2.5.jar:/usr/lib/hadoop/.//hadoop-common-2.4.0.2.1.3.0-563-tests.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//hadoop-nfs.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//hadoop-common-2.4.0.2.1.3.0-563.jar:/usr/lib/hadoop/.//hadoop-nfs-2.4.0.2.1.3.0-563.jar:/usr/lib/hadoop/.//hadoop-auth-2.4.0.2.1.3.0-563.jar:/usr/lib/hadoop/.//hadoop-annotations-2.4.0.2.1.3.0-563.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/usr/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.4.0.2.1.3.0-563.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.4.0.2.1.3.0-563-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-nfs-2.4.0.2.1.3.0-563.jar:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-mapreduce/.//*::/usr/lib/hadoop-mapreduce/* 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/lib/hadoop/lib/native/Linux-amd64-64:/usr/lib/hadoop/lib/native 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=2.6.32-220.23.1.el6.YAHOO.20120713.x86_64 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/home/hbase 2014-08-20 19:51:31,466 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/home/hbase 2014-08-20 19:51:31,467 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=hor17n36.gq1.ygridcore.net:2181 sessionTimeout=30000 watcher=master:16020, quorum=hor17n36.gq1.ygridcore.net:2181, baseZNode=/hbase 2014-08-20 19:51:31,483 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=master:16020 connecting to ZooKeeper ensemble=hor17n36.gq1.ygridcore.net:2181 2014-08-20 19:51:31,493 INFO [main-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Opening socket connection to server hor17n36.gq1.ygridcore.net/206.190.52.55:2181. Will not attempt to authenticate using SASL (unknown error) 2014-08-20 19:51:31,496 INFO [main-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Socket connection established to hor17n36.gq1.ygridcore.net/206.190.52.55:2181, initiating session 2014-08-20 19:51:31,519 INFO [main-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Session establishment complete on server hor17n36.gq1.ygridcore.net/206.190.52.55:2181, sessionid = 0x14765cd18ff04e7, negotiated timeout = 30000 2014-08-20 19:51:31,530 DEBUG [main] zookeeper.RecoverableZooKeeper: Node /hbase already exists 2014-08-20 19:51:31,551 INFO [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: starting 2014-08-20 19:51:31,551 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: starting 2014-08-20 19:51:31,551 DEBUG [main] ipc.RpcExecutor: default Start Handler index=0 queue=0 2014-08-20 19:51:31,551 DEBUG [main] ipc.RpcExecutor: default Start Handler index=1 queue=1 2014-08-20 19:51:31,552 DEBUG [main] ipc.RpcExecutor: default Start Handler index=2 queue=2 2014-08-20 19:51:31,552 DEBUG [main] ipc.RpcExecutor: default Start Handler index=3 queue=3 2014-08-20 19:51:31,552 DEBUG [main] ipc.RpcExecutor: default Start Handler index=4 queue=4 2014-08-20 19:51:31,552 DEBUG [main] ipc.RpcExecutor: default Start Handler index=5 queue=5 2014-08-20 19:51:31,553 DEBUG [main] ipc.RpcExecutor: default Start Handler index=6 queue=0 2014-08-20 19:51:31,553 DEBUG [main] ipc.RpcExecutor: default Start Handler index=7 queue=1 2014-08-20 19:51:31,553 DEBUG [main] ipc.RpcExecutor: default Start Handler index=8 queue=2 2014-08-20 19:51:31,553 DEBUG [main] ipc.RpcExecutor: default Start Handler index=9 queue=3 2014-08-20 19:51:31,553 DEBUG [main] ipc.RpcExecutor: default Start Handler index=10 queue=4 2014-08-20 19:51:31,554 DEBUG [main] ipc.RpcExecutor: default Start Handler index=11 queue=5 2014-08-20 19:51:31,554 DEBUG [main] ipc.RpcExecutor: default Start Handler index=12 queue=0 2014-08-20 19:51:31,554 DEBUG [main] ipc.RpcExecutor: default Start Handler index=13 queue=1 2014-08-20 19:51:31,554 DEBUG [main] ipc.RpcExecutor: default Start Handler index=14 queue=2 2014-08-20 19:51:31,554 DEBUG [main] ipc.RpcExecutor: default Start Handler index=15 queue=3 2014-08-20 19:51:31,555 DEBUG [main] ipc.RpcExecutor: default Start Handler index=16 queue=4 2014-08-20 19:51:31,555 DEBUG [main] ipc.RpcExecutor: default Start Handler index=17 queue=5 2014-08-20 19:51:31,555 DEBUG [main] ipc.RpcExecutor: default Start Handler index=18 queue=0 2014-08-20 19:51:31,555 DEBUG [main] ipc.RpcExecutor: default Start Handler index=19 queue=1 2014-08-20 19:51:31,555 DEBUG [main] ipc.RpcExecutor: default Start Handler index=20 queue=2 2014-08-20 19:51:31,555 DEBUG [main] ipc.RpcExecutor: default Start Handler index=21 queue=3 2014-08-20 19:51:31,556 DEBUG [main] ipc.RpcExecutor: default Start Handler index=22 queue=4 2014-08-20 19:51:31,556 DEBUG [main] ipc.RpcExecutor: default Start Handler index=23 queue=5 2014-08-20 19:51:31,556 DEBUG [main] ipc.RpcExecutor: default Start Handler index=24 queue=0 2014-08-20 19:51:31,556 DEBUG [main] ipc.RpcExecutor: default Start Handler index=25 queue=1 2014-08-20 19:51:31,556 DEBUG [main] ipc.RpcExecutor: default Start Handler index=26 queue=2 2014-08-20 19:51:31,556 DEBUG [main] ipc.RpcExecutor: default Start Handler index=27 queue=3 2014-08-20 19:51:31,557 DEBUG [main] ipc.RpcExecutor: default Start Handler index=28 queue=4 2014-08-20 19:51:31,557 DEBUG [main] ipc.RpcExecutor: default Start Handler index=29 queue=5 2014-08-20 19:51:31,557 DEBUG [main] ipc.RpcExecutor: default Start Handler index=30 queue=0 2014-08-20 19:51:31,557 DEBUG [main] ipc.RpcExecutor: default Start Handler index=31 queue=1 2014-08-20 19:51:31,557 DEBUG [main] ipc.RpcExecutor: default Start Handler index=32 queue=2 2014-08-20 19:51:31,557 DEBUG [main] ipc.RpcExecutor: default Start Handler index=33 queue=3 2014-08-20 19:51:31,557 DEBUG [main] ipc.RpcExecutor: default Start Handler index=34 queue=4 2014-08-20 19:51:31,558 DEBUG [main] ipc.RpcExecutor: default Start Handler index=35 queue=5 2014-08-20 19:51:31,558 DEBUG [main] ipc.RpcExecutor: default Start Handler index=36 queue=0 2014-08-20 19:51:31,558 DEBUG [main] ipc.RpcExecutor: default Start Handler index=37 queue=1 2014-08-20 19:51:31,558 DEBUG [main] ipc.RpcExecutor: default Start Handler index=38 queue=2 2014-08-20 19:51:31,558 DEBUG [main] ipc.RpcExecutor: default Start Handler index=39 queue=3 2014-08-20 19:51:31,558 DEBUG [main] ipc.RpcExecutor: default Start Handler index=40 queue=4 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=41 queue=5 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=42 queue=0 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=43 queue=1 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=44 queue=2 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=45 queue=3 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=46 queue=4 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=47 queue=5 2014-08-20 19:51:31,559 DEBUG [main] ipc.RpcExecutor: default Start Handler index=48 queue=0 2014-08-20 19:51:31,560 DEBUG [main] ipc.RpcExecutor: default Start Handler index=49 queue=1 2014-08-20 19:51:31,560 DEBUG [main] ipc.RpcExecutor: default Start Handler index=50 queue=2 2014-08-20 19:51:31,560 DEBUG [main] ipc.RpcExecutor: default Start Handler index=51 queue=3 2014-08-20 19:51:31,560 DEBUG [main] ipc.RpcExecutor: default Start Handler index=52 queue=4 2014-08-20 19:51:31,560 DEBUG [main] ipc.RpcExecutor: default Start Handler index=53 queue=5 2014-08-20 19:51:31,560 DEBUG [main] ipc.RpcExecutor: default Start Handler index=54 queue=0 2014-08-20 19:51:31,560 DEBUG [main] ipc.RpcExecutor: default Start Handler index=55 queue=1 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: default Start Handler index=56 queue=2 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: default Start Handler index=57 queue=3 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: default Start Handler index=58 queue=4 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: default Start Handler index=59 queue=5 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=0 queue=0 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=1 queue=0 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=2 queue=0 2014-08-20 19:51:31,561 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=3 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=4 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=5 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=6 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=7 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=8 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Priority Start Handler index=9 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Replication Start Handler index=0 queue=0 2014-08-20 19:51:31,562 DEBUG [main] ipc.RpcExecutor: Replication Start Handler index=1 queue=0 2014-08-20 19:51:31,563 DEBUG [main] ipc.RpcExecutor: Replication Start Handler index=2 queue=0 2014-08-20 19:51:31,643 INFO [main] mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2014-08-20 19:51:31,647 INFO [main] http.HttpRequestLog: Http request log for http.requests.master is not defined 2014-08-20 19:51:31,659 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2014-08-20 19:51:31,662 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2014-08-20 19:51:31,662 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2014-08-20 19:51:31,662 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-08-20 19:51:31,680 INFO [main] http.HttpServer: Jetty bound to port 60030 2014-08-20 19:51:31,680 INFO [main] mortbay.log: jetty-6.1.26 2014-08-20 19:51:32,041 INFO [main] mortbay.log: Started SelectChannelConnector@0.0.0.0:60030 2014-08-20 19:51:32,042 INFO [main] master.HMaster: hbase.rootdir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data, hbase.cluster.distributed=true 2014-08-20 19:51:32,054 INFO [main] master.HMaster: Adding ZNode for /hbase/backup-masters/hor17n36.gq1.ygridcore.net,16020,1408564290615 in backup master directory 2014-08-20 19:51:32,127 WARN [main] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:32,154 INFO [main] mortbay.log: jetty-6.1.26 2014-08-20 19:51:32,155 INFO [main] mortbay.log: Started SelectChannelConnector@0.0.0.0:60010 2014-08-20 19:51:32,177 DEBUG [main-EventThread] master.ActiveMasterManager: A master is now available 2014-08-20 19:51:32,177 INFO [ActiveMasterManager] master.ActiveMasterManager: Deleting ZNode for /hbase/backup-masters/hor17n36.gq1.ygridcore.net,16020,1408564290615 from backup master directory 2014-08-20 19:51:32,184 INFO [ActiveMasterManager] master.ActiveMasterManager: Registered Active Master=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:32,192 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: ClusterId : fe7a2ff2-6480-4428-8f72-a1402de9609c 2014-08-20 19:51:32,231 WARN [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:32,295 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.ZooKeeper: Initiating client connection, connectString=hor17n36.gq1.ygridcore.net:2181 sessionTimeout=30000 watcher=hconnection-0xc33d8f7, quorum=hor17n36.gq1.ygridcore.net:2181, baseZNode=/hbase 2014-08-20 19:51:32,296 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0xc33d8f7 connecting to ZooKeeper ensemble=hor17n36.gq1.ygridcore.net:2181 2014-08-20 19:51:32,296 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Opening socket connection to server hor17n36.gq1.ygridcore.net/206.190.52.55:2181. Will not attempt to authenticate using SASL (unknown error) 2014-08-20 19:51:32,296 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Socket connection established to hor17n36.gq1.ygridcore.net/206.190.52.55:2181, initiating session 2014-08-20 19:51:32,308 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Session establishment complete on server hor17n36.gq1.ygridcore.net/206.190.52.55:2181, sessionid = 0x14765cd18ff04e8, negotiated timeout = 30000 2014-08-20 19:51:32,320 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] ipc.RpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5979377b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2014-08-20 19:51:32,333 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot is initializing 2014-08-20 19:51:32,341 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.RecoverableZooKeeper: Node /hbase/online-snapshot/acquired already exists 2014-08-20 19:51:32,344 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot is initialized 2014-08-20 19:51:32,344 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc is initializing 2014-08-20 19:51:32,349 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.RecoverableZooKeeper: Node /hbase/flush-table-proc/acquired already exists 2014-08-20 19:51:32,350 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc is initialized 2014-08-20 19:51:32,356 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=4.0 G, globalMemStoreLimitLowMark=3.2 G, maxHeap=19.9 G 2014-08-20 19:51:32,360 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: CompactionChecker runs every 10sec 2014-08-20 19:51:32,362 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] ipc.RpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@612ec15a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=hor17n36.gq1.ygridcore.net/206.190.52.55:0 2014-08-20 19:51:32,367 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 19:51:32,383 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: reportForDuty to master=hor17n36.gq1.ygridcore.net,16020,1408564290615 with port=16020, startcode=1408564290615 2014-08-20 19:51:32,389 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: Master is not running yet 2014-08-20 19:51:32,389 WARN [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: reportForDuty failed; sleeping and then retrying. 2014-08-20 19:51:32,693 WARN [ActiveMasterManager] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:32,700 DEBUG [ActiveMasterManager] util.FSTableDescriptors: Current tableInfoPath = hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/.tabledesc/.tableinfo.0000000002 2014-08-20 19:51:32,739 DEBUG [ActiveMasterManager] util.FSTableDescriptors: TableInfo already exists.. Skipping creation 2014-08-20 19:51:32,779 INFO [ActiveMasterManager] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-08-20 19:51:32,789 DEBUG [ActiveMasterManager] master.SplitLogManager: Distributed log replay=true, hfile.format.version=3 2014-08-20 19:51:32,793 INFO [ActiveMasterManager] master.SplitLogManager: Timeout=120000, unassigned timeout=180000, distributedLogReplay=true 2014-08-20 19:51:32,794 INFO [ActiveMasterManager] master.SplitLogManager: Found 0 orphan tasks and 0 rescan nodes 2014-08-20 19:51:32,873 DEBUG [ActiveMasterManager] zookeeper.RegionServerTracker: RS node: /hbase/rs/hor17n36.gq1.ygridcore.net,16020,1408564290615 data: PBUF�� 2014-08-20 19:51:32,874 INFO [ActiveMasterManager] master.HMaster: Server active/primary master=hor17n36.gq1.ygridcore.net,16020,1408564290615, sessionid=0x14765cd18ff04e7, setting cluster-up flag (Was=true) 2014-08-20 19:51:32,890 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper: Node /hbase/online-snapshot/acquired already exists 2014-08-20 19:51:32,891 INFO [ActiveMasterManager] procedure.ZKProcedureUtil: Clearing all procedure znodes: /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2014-08-20 19:51:32,893 DEBUG [ActiveMasterManager] procedure.ZKProcedureCoordinatorRpcs: Starting the controller for procedure member:hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:32,907 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper: Node /hbase/flush-table-proc/acquired already exists 2014-08-20 19:51:32,908 INFO [ActiveMasterManager] procedure.ZKProcedureUtil: Clearing all procedure znodes: /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2014-08-20 19:51:32,910 DEBUG [ActiveMasterManager] procedure.ZKProcedureCoordinatorRpcs: Starting the controller for procedure member:hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:32,934 DEBUG [ActiveMasterManager] executor.ExecutorService: Starting executor service name=MASTER_OPEN_REGION-hor17n36:16020, corePoolSize=5, maxPoolSize=5 2014-08-20 19:51:32,934 DEBUG [ActiveMasterManager] executor.ExecutorService: Starting executor service name=MASTER_CLOSE_REGION-hor17n36:16020, corePoolSize=5, maxPoolSize=5 2014-08-20 19:51:32,935 DEBUG [ActiveMasterManager] executor.ExecutorService: Starting executor service name=MASTER_SERVER_OPERATIONS-hor17n36:16020, corePoolSize=5, maxPoolSize=5 2014-08-20 19:51:32,935 DEBUG [ActiveMasterManager] executor.ExecutorService: Starting executor service name=MASTER_META_SERVER_OPERATIONS-hor17n36:16020, corePoolSize=5, maxPoolSize=5 2014-08-20 19:51:32,935 DEBUG [ActiveMasterManager] executor.ExecutorService: Starting executor service name=M_LOG_REPLAY_OPS-hor17n36:16020, corePoolSize=10, maxPoolSize=10 2014-08-20 19:51:32,935 DEBUG [ActiveMasterManager] executor.ExecutorService: Starting executor service name=MASTER_TABLE_OPERATIONS-hor17n36:16020, corePoolSize=1, maxPoolSize=1 2014-08-20 19:51:32,937 DEBUG [ActiveMasterManager] cleaner.CleanerChore: initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2014-08-20 19:51:32,940 INFO [ActiveMasterManager] zookeeper.ZooKeeper: Initiating client connection, connectString=hor17n36.gq1.ygridcore.net:2181 sessionTimeout=30000 watcher=replicationLogCleaner, quorum=hor17n36.gq1.ygridcore.net:2181, baseZNode=/hbase 2014-08-20 19:51:32,941 INFO [ActiveMasterManager] zookeeper.RecoverableZooKeeper: Process identifier=replicationLogCleaner connecting to ZooKeeper ensemble=hor17n36.gq1.ygridcore.net:2181 2014-08-20 19:51:32,941 INFO [ActiveMasterManager-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Opening socket connection to server hor17n36.gq1.ygridcore.net/206.190.52.55:2181. Will not attempt to authenticate using SASL (unknown error) 2014-08-20 19:51:32,942 INFO [ActiveMasterManager-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Socket connection established to hor17n36.gq1.ygridcore.net/206.190.52.55:2181, initiating session 2014-08-20 19:51:32,949 INFO [ActiveMasterManager-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Session establishment complete on server hor17n36.gq1.ygridcore.net/206.190.52.55:2181, sessionid = 0x14765cd18ff04e9, negotiated timeout = 30000 2014-08-20 19:51:32,957 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper: Node /hbase/replication/rs already exists 2014-08-20 19:51:32,957 DEBUG [ActiveMasterManager] cleaner.CleanerChore: initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2014-08-20 19:51:32,960 DEBUG [ActiveMasterManager] cleaner.CleanerChore: initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotLogCleaner 2014-08-20 19:51:32,961 DEBUG [ActiveMasterManager] cleaner.CleanerChore: initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2014-08-20 19:51:32,962 DEBUG [ActiveMasterManager] cleaner.CleanerChore: initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2014-08-20 19:51:32,963 DEBUG [ActiveMasterManager] cleaner.CleanerChore: initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2014-08-20 19:51:32,963 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: reportForDuty to master=hor17n36.gq1.ygridcore.net,16020,1408564290615 with port=16020, startcode=1408564290615 2014-08-20 19:51:32,963 INFO [ActiveMasterManager] master.ServerManager: Waiting for region servers count to settle; currently checked in 0, slept for 0 ms, expecting minimum of 1, maximum of 2147483647, timeout of 4500 ms, interval of 1500 ms, selfCheckedIn false 2014-08-20 19:51:32,970 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] master.ServerManager: Registering server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:32,975 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data 2014-08-20 19:51:32,975 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://hor17n36.gq1.ygridcore.net:8020 2014-08-20 19:51:32,975 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=60030 2014-08-20 19:51:32,975 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: logdir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:33,013 INFO [ActiveMasterManager] master.ServerManager: Waiting for region servers count to settle; currently checked in 1, slept for 50 ms, expecting minimum of 1, maximum of 2147483647, timeout of 4500 ms, interval of 1500 ms, selfCheckedIn true 2014-08-20 19:51:33,016 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.Replication: ReplicationStatisticsThread 300 2014-08-20 19:51:33,039 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] wal.FSHLog: WAL configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, prefix=hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615, logDir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615, oldLogDir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/oldWALs 2014-08-20 19:51:33,210 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] wal.FSHLog: Slow sync cost: 106 ms, current pipeline: [] 2014-08-20 19:51:33,210 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] wal.FSHLog: New WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564293059 2014-08-20 19:51:33,243 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2014-08-20 19:51:33,247 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-hor17n36:16020, corePoolSize=3, maxPoolSize=3 2014-08-20 19:51:33,247 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-hor17n36:16020, corePoolSize=1, maxPoolSize=1 2014-08-20 19:51:33,247 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-hor17n36:16020, corePoolSize=3, maxPoolSize=3 2014-08-20 19:51:33,248 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-hor17n36:16020, corePoolSize=1, maxPoolSize=1 2014-08-20 19:51:33,248 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-hor17n36:16020, corePoolSize=2, maxPoolSize=2 2014-08-20 19:51:33,251 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.ReplicationSourceManager: Current list of replicators: [hor17n36.gq1.ygridcore.net,16020,1408564290615] other RSs: [hor17n36.gq1.ygridcore.net,16020,1408564290615] 2014-08-20 19:51:33,272 WARN [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:33,280 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.ZooKeeper: Initiating client connection, connectString=hor17n36.gq1.ygridcore.net:2181 sessionTimeout=30000 watcher=hconnection-0x1b3f459d, quorum=hor17n36.gq1.ygridcore.net:2181, baseZNode=/hbase 2014-08-20 19:51:33,281 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x1b3f459d connecting to ZooKeeper ensemble=hor17n36.gq1.ygridcore.net:2181 2014-08-20 19:51:33,282 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Opening socket connection to server hor17n36.gq1.ygridcore.net/206.190.52.55:2181. Will not attempt to authenticate using SASL (unknown error) 2014-08-20 19:51:33,283 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Socket connection established to hor17n36.gq1.ygridcore.net/206.190.52.55:2181, initiating session 2014-08-20 19:51:33,290 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Session establishment complete on server hor17n36.gq1.ygridcore.net/206.190.52.55:2181, sessionid = 0x14765cd18ff04ea, negotiated timeout = 30000 2014-08-20 19:51:33,292 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] ipc.RpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c2a20ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2014-08-20 19:51:33,314 WARN [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:33,321 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615] regionserver.SplitLogWorker: SplitLogWorker hor17n36.gq1.ygridcore.net,16020,1408564290615 starting 2014-08-20 19:51:33,323 WARN [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:33,323 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: Serving as hor17n36.gq1.ygridcore.net,16020,1408564290615, RpcServer on hor17n36.gq1.ygridcore.net/206.190.52.55:16020, sessionid=0x14765cd18ff04e7 2014-08-20 19:51:33,323 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot is starting 2014-08-20 19:51:33,323 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:33,323 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'hor17n36.gq1.ygridcore.net,16020,1408564290615' 2014-08-20 19:51:33,323 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2014-08-20 19:51:33,324 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2014-08-20 19:51:33,325 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot is started 2014-08-20 19:51:33,325 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc is starting 2014-08-20 19:51:33,325 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:33,325 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615] zookeeper.ZooKeeper: Initiating client connection, connectString=hor17n36.gq1.ygridcore.net:2181 sessionTimeout=30000 watcher=hconnection-0x67476ee3, quorum=hor17n36.gq1.ygridcore.net:2181, baseZNode=/hbase 2014-08-20 19:51:33,325 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'hor17n36.gq1.ygridcore.net,16020,1408564290615' 2014-08-20 19:51:33,325 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2014-08-20 19:51:33,325 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2014-08-20 19:51:33,325 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x67476ee3 connecting to ZooKeeper ensemble=hor17n36.gq1.ygridcore.net:2181 2014-08-20 19:51:33,326 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Opening socket connection to server hor17n36.gq1.ygridcore.net/206.190.52.55:2181. Will not attempt to authenticate using SASL (unknown error) 2014-08-20 19:51:33,326 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc is started 2014-08-20 19:51:33,326 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Socket connection established to hor17n36.gq1.ygridcore.net/206.190.52.55:2181, initiating session 2014-08-20 19:51:33,331 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615-SendThread(hor17n36.gq1.ygridcore.net:2181)] zookeeper.ClientCnxn: Session establishment complete on server hor17n36.gq1.ygridcore.net/206.190.52.55:2181, sessionid = 0x14765cd18ff04eb, negotiated timeout = 30000 2014-08-20 19:51:33,333 DEBUG [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615] ipc.RpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d25dad6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2014-08-20 19:51:34,519 INFO [ActiveMasterManager] master.ServerManager: Waiting for region servers count to settle; currently checked in 1, slept for 1556 ms, expecting minimum of 1, maximum of 2147483647, timeout of 4500 ms, interval of 1500 ms, selfCheckedIn true 2014-08-20 19:51:36,025 INFO [ActiveMasterManager] master.ServerManager: Waiting for region servers count to settle; currently checked in 1, slept for 3062 ms, expecting minimum of 1, maximum of 2147483647, timeout of 4500 ms, interval of 1500 ms, selfCheckedIn true 2014-08-20 19:51:37,481 INFO [ActiveMasterManager] master.ServerManager: Finished waiting for region servers count to settle; checked in 1, slept for 4518 ms, expecting minimum of 1, maximum of 2147483647, master is running, selfCheckedIn true 2014-08-20 19:51:37,486 INFO [ActiveMasterManager] master.MasterFileSystem: Log folder hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615 belongs to an existing region server 2014-08-20 19:51:37,674 DEBUG [ActiveMasterManager] ipc.RpcClient: Use SIMPLE authentication for service AdminService, sasl=false 2014-08-20 19:51:37,686 DEBUG [ActiveMasterManager] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 19:51:37,688 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 19:51:37,697 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:41634; # active connections: 1 2014-08-20 19:51:37,715 DEBUG [PriorityRpcServer.handler=0,queue=0,port=16020] ipc.RpcServer: PriorityRpcServer.handler=0,queue=0,port=16020: callId: 0 service: AdminService methodName: GetRegionInfo size: 40 connection: 206.190.52.55:41634 org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online on hor17n36.gq1.ygridcore.net,16020,1408564290615 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2616) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:796) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionInfo(RSRpcServices.java:1065) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:20158) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2014) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) at java.lang.Thread.run(Thread.java:744) 2014-08-20 19:51:37,727 INFO [ActiveMasterManager] zookeeper.MetaTableLocator: Failed verification of hbase:meta,,1 at address=hor17n36.gq1.ygridcore.net,16020,1408554989900, exception=org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online on hor17n36.gq1.ygridcore.net,16020,1408564290615 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2616) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:796) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegionInfo(RSRpcServices.java:1065) at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:20158) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2014) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) at java.lang.Thread.run(Thread.java:744) 2014-08-20 19:51:37,769 DEBUG [ActiveMasterManager] master.SplitLogManager: Mark region 1588230740 recovering from failed region server hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:37,769 INFO [ActiveMasterManager] zookeeper.MetaTableLocator: Unsetting hbase:meta region location in ZooKeeper 2014-08-20 19:51:37,810 DEBUG [ActiveMasterManager] master.AssignmentManager: No previous transition plan found (or ignoring an existing plan) for hbase:meta,,1.1588230740; generated random plan=hri=hbase:meta,,1.1588230740, src=, dest=hor17n36.gq1.ygridcore.net,16020,1408564290615; 1 (online=1) available servers, forceNewPlan=false 2014-08-20 19:51:37,810 INFO [ActiveMasterManager] master.AssignmentManager: Assigning hbase:meta,,1.1588230740 to hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:37,810 INFO [ActiveMasterManager] master.RegionStates: Transition {1588230740 state=OFFLINE, ts=1408564297496, server=null} to {1588230740 state=PENDING_OPEN, ts=1408564297810, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:37,810 DEBUG [ActiveMasterManager] master.ServerManager: New admin connection to hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:37,820 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2014-08-20 19:51:37,825 DEBUG [RS_OPEN_META-hor17n36:16020-0] regionserver.HRegionServer: logdir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:37,826 INFO [RS_OPEN_META-hor17n36:16020-0] wal.FSHLog: WAL configuration: blocksize=128 MB, rollsize=121.60 MB, enabled=true, prefix=hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615, logDir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615, oldLogDir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/oldWALs 2014-08-20 19:51:37,829 INFO [ActiveMasterManager] master.MasterFileSystem: Log dir for server hor17n36.gq1.ygridcore.net,16020,1408554989900 does not exist 2014-08-20 19:51:37,830 INFO [ActiveMasterManager] master.SplitLogManager: dead splitlog workers [hor17n36.gq1.ygridcore.net,16020,1408554989900] 2014-08-20 19:51:37,830 DEBUG [ActiveMasterManager] master.SplitLogManager: Scheduling batch of logs to split 2014-08-20 19:51:37,830 INFO [ActiveMasterManager] master.SplitLogManager: started splitting 0 logs in [] 2014-08-20 19:51:37,869 INFO [main-EventThread] zookeeper.RecoveringRegionWatcher: /hbase/recovering-regions/1588230740 znode deleted. Region: 1588230740 completes recovery. 2014-08-20 19:51:37,869 INFO [ActiveMasterManager] master.SplitLogManager: finished splitting (more than or equal to) 0 bytes in 0 log files in [] in 39ms 2014-08-20 19:51:37,869 INFO [ActiveMasterManager] master.ServerManager: AssignmentManager hasn't finished failover cleanup; waiting 2014-08-20 19:51:37,877 INFO [RS_OPEN_META-hor17n36:16020-0] wal.FSHLog: Slow sync cost: 32 ms, current pipeline: [] 2014-08-20 19:51:37,878 INFO [RS_OPEN_META-hor17n36:16020-0] wal.FSHLog: New WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564297828.meta 2014-08-20 19:51:37,880 DEBUG [RS_OPEN_META-hor17n36:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2014-08-20 19:51:37,924 DEBUG [RS_OPEN_META-hor17n36:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2014-08-20 19:51:37,927 DEBUG [RS_OPEN_META-hor17n36:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2014-08-20 19:51:37,930 INFO [RS_OPEN_META-hor17n36:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2014-08-20 19:51:37,935 DEBUG [RS_OPEN_META-hor17n36:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2014-08-20 19:51:37,935 DEBUG [RS_OPEN_META-hor17n36:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2014-08-20 19:51:37,978 WARN [StoreOpener-1588230740-1] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:37,988 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=13143568, freeSize=12803731952, maxSize=12816875520, heapSize=13143568, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:37,996 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,015 DEBUG [StoreFileOpenerThread-info-1] util.ChecksumType: Checksum using org.apache.hadoop.util.PureJavaCrc32 2014-08-20 19:51:38,015 DEBUG [StoreFileOpenerThread-info-1] util.ChecksumType: Checksum can use org.apache.hadoop.util.PureJavaCrc32C 2014-08-20 19:51:38,077 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/07e7b86441fb4b8996905bc66608c5e3, isReference=false, isBulkLoadResult=false, seqid=75461, majorCompaction=true 2014-08-20 19:51:38,086 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/edaee66bbec84210bf8deb94f63a7b3c, isReference=false, isBulkLoadResult=false, seqid=75508, majorCompaction=false 2014-08-20 19:51:38,094 DEBUG [RS_OPEN_META-hor17n36:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740 2014-08-20 19:51:38,107 INFO [RS_OPEN_META-hor17n36:16020-0] regionserver.HRegion: Onlined 1588230740; next sequenceid=75509 2014-08-20 19:51:38,133 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2014-08-20 19:51:38,134 INFO [PostOpenDeployTasks:1588230740] zookeeper.MetaTableLocator: Setting hbase:meta region location in ZooKeeper as hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,153 DEBUG [PostOpenDeployTasks:1588230740] master.AssignmentManager: Got transition OPENED for {1588230740 state=PENDING_OPEN, ts=1408564297810, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,153 INFO [PostOpenDeployTasks:1588230740] master.RegionStates: Transition {1588230740 state=PENDING_OPEN, ts=1408564297810, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {1588230740 state=OPEN, ts=1408564298153, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,153 INFO [PostOpenDeployTasks:1588230740] master.RegionStates: Onlined 1588230740 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,154 INFO [ActiveMasterManager] master.HMaster: hbase:meta assigned=1, location=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,156 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2014-08-20 19:51:38,156 DEBUG [RS_OPEN_META-hor17n36:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,285 DEBUG [ActiveMasterManager] client.ScannerCallableWithReplicas: Closing scanner 1 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {221216a6df76088820c4d89a24c66fa0 state=OPEN, ts=1408564298305, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {221216a6df76088820c4d89a24c66fa0 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {6eb8b87c16dd214f35e9ab2f64c4634a state=OPEN, ts=1408564298302, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {6eb8b87c16dd214f35e9ab2f64c4634a state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {647e9e38812e56782b2802d9f8a216c3 state=OPEN, ts=1408564298302, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {647e9e38812e56782b2802d9f8a216c3 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {67414220d844ede17df98e3f63fb0536 state=OPEN, ts=1408564298300, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {67414220d844ede17df98e3f63fb0536 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {484fab46de6b0ae27958354313d20b23 state=OPEN, ts=1408564298301, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {484fab46de6b0ae27958354313d20b23 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {9b4e77649e34b8667cb655ed6788ae06 state=OPEN, ts=1408564298303, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {9b4e77649e34b8667cb655ed6788ae06 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {a0333fe1d1e09a008b55f6346d998370 state=OPEN, ts=1408564298304, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {a0333fe1d1e09a008b55f6346d998370 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {35556b0cd9ee4aeb9ccdef2e502703d1 state=OPEN, ts=1408564298299, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {35556b0cd9ee4aeb9ccdef2e502703d1 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,308 INFO [ActiveMasterManager] master.RegionStates: Transition {6246293acada9511ad1ed27a2c136b3d state=OPEN, ts=1408564298304, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {6246293acada9511ad1ed27a2c136b3d state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,309 INFO [ActiveMasterManager] master.RegionStates: Transition {b67f1ed699b2b31d5360b0f8245839a6 state=OPEN, ts=1408564298305, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {b67f1ed699b2b31d5360b0f8245839a6 state=CLOSED, ts=1408564298309, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,309 INFO [ActiveMasterManager] master.RegionStates: Transition {df92c867f561868284729e0deeb615ce state=OPEN, ts=1408564298300, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {df92c867f561868284729e0deeb615ce state=CLOSED, ts=1408564298309, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} 2014-08-20 19:51:38,309 INFO [ActiveMasterManager] master.AssignmentManager: Clean cluster startup. Assigning user regions 2014-08-20 19:51:38,309 INFO [ActiveMasterManager] master.AssignmentManager: Assigning 11 region(s) to hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,309 INFO [ActiveMasterManager] master.RegionStates: Transition {221216a6df76088820c4d89a24c66fa0 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {221216a6df76088820c4d89a24c66fa0 state=PENDING_OPEN, ts=1408564298309, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,310 INFO [ActiveMasterManager] master.RegionStateStore: Updating row hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,318 INFO [ActiveMasterManager] master.RegionStates: Transition {6eb8b87c16dd214f35e9ab2f64c4634a state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {6eb8b87c16dd214f35e9ab2f64c4634a state=PENDING_OPEN, ts=1408564298318, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,319 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,320 INFO [ActiveMasterManager] master.RegionStates: Transition {67414220d844ede17df98e3f63fb0536 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {67414220d844ede17df98e3f63fb0536 state=PENDING_OPEN, ts=1408564298320, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,320 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,322 INFO [ActiveMasterManager] master.RegionStates: Transition {647e9e38812e56782b2802d9f8a216c3 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {647e9e38812e56782b2802d9f8a216c3 state=PENDING_OPEN, ts=1408564298322, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,322 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,324 INFO [ActiveMasterManager] master.RegionStates: Transition {484fab46de6b0ae27958354313d20b23 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {484fab46de6b0ae27958354313d20b23 state=PENDING_OPEN, ts=1408564298324, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,324 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,326 INFO [ActiveMasterManager] master.RegionStates: Transition {35556b0cd9ee4aeb9ccdef2e502703d1 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {35556b0cd9ee4aeb9ccdef2e502703d1 state=PENDING_OPEN, ts=1408564298326, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,326 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,328 INFO [ActiveMasterManager] master.RegionStates: Transition {a0333fe1d1e09a008b55f6346d998370 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {a0333fe1d1e09a008b55f6346d998370 state=PENDING_OPEN, ts=1408564298328, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,328 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,329 INFO [ActiveMasterManager] master.RegionStates: Transition {9b4e77649e34b8667cb655ed6788ae06 state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {9b4e77649e34b8667cb655ed6788ae06 state=PENDING_OPEN, ts=1408564298329, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,330 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,331 INFO [ActiveMasterManager] master.RegionStates: Transition {6246293acada9511ad1ed27a2c136b3d state=CLOSED, ts=1408564298308, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {6246293acada9511ad1ed27a2c136b3d state=PENDING_OPEN, ts=1408564298331, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,332 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,333 INFO [ActiveMasterManager] master.RegionStates: Transition {b67f1ed699b2b31d5360b0f8245839a6 state=CLOSED, ts=1408564298309, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {b67f1ed699b2b31d5360b0f8245839a6 state=PENDING_OPEN, ts=1408564298333, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,333 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,335 INFO [ActiveMasterManager] master.RegionStates: Transition {df92c867f561868284729e0deeb615ce state=CLOSED, ts=1408564298309, server=hor17n36.gq1.ygridcore.net,16020,1408554989900} to {df92c867f561868284729e0deeb615ce state=PENDING_OPEN, ts=1408564298335, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,335 INFO [ActiveMasterManager] master.RegionStateStore: Updating row TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. with state=PENDING_OPEN&sn=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,337 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 19:51:38,357 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 19:51:38,359 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Opening region: {ENCODED => 221216a6df76088820c4d89a24c66fa0, NAME => 'hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0.', STARTKEY => '', ENDKEY => ''} 2014-08-20 19:51:38,360 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 221216a6df76088820c4d89a24c66fa0 2014-08-20 19:51:38,360 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 19:51:38,365 INFO [StoreOpener-221216a6df76088820c4d89a24c66fa0-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=12, currentSize=13236560, freeSize=12803638960, maxSize=12816875520, heapSize=13236560, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,366 INFO [StoreOpener-221216a6df76088820c4d89a24c66fa0-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,383 DEBUG [StoreOpener-221216a6df76088820c4d89a24c66fa0-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/namespace/221216a6df76088820c4d89a24c66fa0/info/107b4d579861465ea86a923632516258, isReference=false, isBulkLoadResult=false, seqid=4, majorCompaction=false 2014-08-20 19:51:38,387 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/namespace/221216a6df76088820c4d89a24c66fa0 2014-08-20 19:51:38,391 INFO [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Onlined 221216a6df76088820c4d89a24c66fa0; next sequenceid=5 2014-08-20 19:51:38,394 INFO [PostOpenDeployTasks:221216a6df76088820c4d89a24c66fa0] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 19:51:38,394 DEBUG [PostOpenDeployTasks:221216a6df76088820c4d89a24c66fa0] master.AssignmentManager: Got transition OPENED for {221216a6df76088820c4d89a24c66fa0 state=PENDING_OPEN, ts=1408564298309, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,394 INFO [PostOpenDeployTasks:221216a6df76088820c4d89a24c66fa0] master.RegionStates: Transition {221216a6df76088820c4d89a24c66fa0 state=PENDING_OPEN, ts=1408564298309, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {221216a6df76088820c4d89a24c66fa0 state=OPEN, ts=1408564298394, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,395 INFO [PostOpenDeployTasks:221216a6df76088820c4d89a24c66fa0] master.RegionStateStore: Updating row hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. with state=OPEN&openSeqNum=5&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,398 INFO [PostOpenDeployTasks:221216a6df76088820c4d89a24c66fa0] master.RegionStates: Onlined 221216a6df76088820c4d89a24c66fa0 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,398 INFO [PostOpenDeployTasks:221216a6df76088820c4d89a24c66fa0] master.RegionStates: Offlined 221216a6df76088820c4d89a24c66fa0 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,398 DEBUG [PostOpenDeployTasks:221216a6df76088820c4d89a24c66fa0] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 19:51:38,398 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,399 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 19:51:38,399 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Opening region: {ENCODED => 6eb8b87c16dd214f35e9ab2f64c4634a, NAME => 'TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a.', STARTKEY => '00000000000000000041943040', ENDKEY => '00000000000000000052428800'} 2014-08-20 19:51:38,400 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable 6eb8b87c16dd214f35e9ab2f64c4634a 2014-08-20 19:51:38,400 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Instantiated TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 19:51:38,400 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 19:51:38,400 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Opening region: {ENCODED => 67414220d844ede17df98e3f63fb0536, NAME => 'TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536.', STARTKEY => '00000000000000000010485760', ENDKEY => '00000000000000000020971520'} 2014-08-20 19:51:38,401 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable 67414220d844ede17df98e3f63fb0536 2014-08-20 19:51:38,401 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Instantiated TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 19:51:38,401 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 19:51:38,402 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Opening region: {ENCODED => 647e9e38812e56782b2802d9f8a216c3, NAME => 'TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3.', STARTKEY => '00000000000000000052428800', ENDKEY => '00000000000000000062914560'} 2014-08-20 19:51:38,402 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 19:51:38,402 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable 647e9e38812e56782b2802d9f8a216c3 2014-08-20 19:51:38,402 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Instantiated TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 19:51:38,402 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 19:51:38,403 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 19:51:38,404 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 19:51:38,405 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 19:51:38,405 INFO [ActiveMasterManager] regionserver.RSRpcServices: Open TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 19:51:38,406 DEBUG [ActiveMasterManager] master.AssignmentManager: Bulk assigning done for hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,409 INFO [RS_OPEN_REGION-hor17n36:16020-2] compress.CodecPool: Got brand-new compressor [.snappy] 2014-08-20 19:51:38,409 INFO [RS_OPEN_REGION-hor17n36:16020-1] compress.CodecPool: Got brand-new compressor [.snappy] 2014-08-20 19:51:38,409 INFO [RS_OPEN_REGION-hor17n36:16020-0] compress.CodecPool: Got brand-new compressor [.snappy] 2014-08-20 19:51:38,414 INFO [StoreOpener-67414220d844ede17df98e3f63fb0536-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=12, currentSize=13236560, freeSize=12803638960, maxSize=12816875520, heapSize=13236560, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,415 INFO [StoreOpener-6eb8b87c16dd214f35e9ab2f64c4634a-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=12, currentSize=13236560, freeSize=12803638960, maxSize=12816875520, heapSize=13236560, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,415 INFO [StoreOpener-647e9e38812e56782b2802d9f8a216c3-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=12, currentSize=13236560, freeSize=12803638960, maxSize=12816875520, heapSize=13236560, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,416 INFO [StoreOpener-67414220d844ede17df98e3f63fb0536-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,416 INFO [StoreOpener-647e9e38812e56782b2802d9f8a216c3-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,416 INFO [StoreOpener-6eb8b87c16dd214f35e9ab2f64c4634a-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,442 INFO [ActiveMasterManager] master.AssignmentManager: Joined the cluster in 288ms, failover=false 2014-08-20 19:51:38,454 DEBUG [htable-pool7-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 19:51:38,455 DEBUG [htable-pool7-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 19:51:38,455 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:41636; # active connections: 2 2014-08-20 19:51:38,457 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 2 2014-08-20 19:51:38,465 DEBUG [ActiveMasterManager] client.ScannerCallableWithReplicas: Closing scanner 2 2014-08-20 19:51:38,473 DEBUG [ActiveMasterManager] hbase.ZKNamespaceManager: Updating namespace cache from node default with data: \x0A\x07default 2014-08-20 19:51:38,476 DEBUG [ActiveMasterManager] hbase.ZKNamespaceManager: Updating namespace cache from node hbase with data: \x0A\x05hbase 2014-08-20 19:51:38,490 INFO [StoreFileOpenerThread-info-1] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 19:51:38,493 INFO [StoreFileOpenerThread-info-1] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 19:51:38,495 DEBUG [StoreOpener-67414220d844ede17df98e3f63fb0536-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/67414220d844ede17df98e3f63fb0536/info/7e0fe3f80adf4ddb931028faebe53d3f, isReference=false, isBulkLoadResult=false, seqid=15254, majorCompaction=true 2014-08-20 19:51:38,495 DEBUG [StoreOpener-6eb8b87c16dd214f35e9ab2f64c4634a-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/6eb8b87c16dd214f35e9ab2f64c4634a/info/9757f26a586841d1ab618fb6fcfd9793, isReference=false, isBulkLoadResult=false, seqid=15250, majorCompaction=true 2014-08-20 19:51:38,499 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/67414220d844ede17df98e3f63fb0536 2014-08-20 19:51:38,500 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/6eb8b87c16dd214f35e9ab2f64c4634a 2014-08-20 19:51:38,500 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 3 2014-08-20 19:51:38,506 INFO [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Onlined 67414220d844ede17df98e3f63fb0536; next sequenceid=15255 2014-08-20 19:51:38,508 INFO [PostOpenDeployTasks:67414220d844ede17df98e3f63fb0536] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 19:51:38,510 DEBUG [PostOpenDeployTasks:67414220d844ede17df98e3f63fb0536] master.AssignmentManager: Got transition OPENED for {67414220d844ede17df98e3f63fb0536 state=PENDING_OPEN, ts=1408564298320, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,510 INFO [PostOpenDeployTasks:67414220d844ede17df98e3f63fb0536] master.RegionStates: Transition {67414220d844ede17df98e3f63fb0536 state=PENDING_OPEN, ts=1408564298320, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {67414220d844ede17df98e3f63fb0536 state=OPEN, ts=1408564298510, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,510 INFO [PostOpenDeployTasks:67414220d844ede17df98e3f63fb0536] master.RegionStateStore: Updating row TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. with state=OPEN&openSeqNum=15255&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,510 DEBUG [StoreOpener-647e9e38812e56782b2802d9f8a216c3-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/647e9e38812e56782b2802d9f8a216c3/info/3ed46d9c49e640f7bfbe7cd90fcf9d60, isReference=false, isBulkLoadResult=false, seqid=15251, majorCompaction=true 2014-08-20 19:51:38,513 INFO [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Onlined 6eb8b87c16dd214f35e9ab2f64c4634a; next sequenceid=15251 2014-08-20 19:51:38,513 INFO [PostOpenDeployTasks:67414220d844ede17df98e3f63fb0536] master.RegionStates: Onlined 67414220d844ede17df98e3f63fb0536 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,513 INFO [PostOpenDeployTasks:67414220d844ede17df98e3f63fb0536] master.RegionStates: Offlined 67414220d844ede17df98e3f63fb0536 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,514 DEBUG [PostOpenDeployTasks:67414220d844ede17df98e3f63fb0536] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 19:51:38,514 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] handler.OpenRegionHandler: Opened TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,515 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Opening region: {ENCODED => 484fab46de6b0ae27958354313d20b23, NAME => 'TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23.', STARTKEY => '00000000000000000031457280', ENDKEY => '00000000000000000041943040'} 2014-08-20 19:51:38,516 INFO [PostOpenDeployTasks:6eb8b87c16dd214f35e9ab2f64c4634a] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 19:51:38,516 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable 484fab46de6b0ae27958354313d20b23 2014-08-20 19:51:38,516 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Instantiated TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 19:51:38,516 DEBUG [PostOpenDeployTasks:6eb8b87c16dd214f35e9ab2f64c4634a] master.AssignmentManager: Got transition OPENED for {6eb8b87c16dd214f35e9ab2f64c4634a state=PENDING_OPEN, ts=1408564298318, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,517 INFO [PostOpenDeployTasks:6eb8b87c16dd214f35e9ab2f64c4634a] master.RegionStates: Transition {6eb8b87c16dd214f35e9ab2f64c4634a state=PENDING_OPEN, ts=1408564298318, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {6eb8b87c16dd214f35e9ab2f64c4634a state=OPEN, ts=1408564298517, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,517 INFO [PostOpenDeployTasks:6eb8b87c16dd214f35e9ab2f64c4634a] master.RegionStateStore: Updating row TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. with state=OPEN&openSeqNum=15251&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,519 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/647e9e38812e56782b2802d9f8a216c3 2014-08-20 19:51:38,522 INFO [PostOpenDeployTasks:6eb8b87c16dd214f35e9ab2f64c4634a] master.RegionStates: Onlined 6eb8b87c16dd214f35e9ab2f64c4634a on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,522 INFO [PostOpenDeployTasks:6eb8b87c16dd214f35e9ab2f64c4634a] master.RegionStates: Offlined 6eb8b87c16dd214f35e9ab2f64c4634a from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,522 DEBUG [PostOpenDeployTasks:6eb8b87c16dd214f35e9ab2f64c4634a] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 19:51:38,522 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] handler.OpenRegionHandler: Opened TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,523 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Opening region: {ENCODED => 35556b0cd9ee4aeb9ccdef2e502703d1, NAME => 'TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1.', STARTKEY => '', ENDKEY => '00000000000000000010485760'} 2014-08-20 19:51:38,524 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable 35556b0cd9ee4aeb9ccdef2e502703d1 2014-08-20 19:51:38,524 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Instantiated TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 19:51:38,525 INFO [StoreOpener-484fab46de6b0ae27958354313d20b23-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,527 INFO [StoreOpener-484fab46de6b0ae27958354313d20b23-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,528 INFO [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Onlined 647e9e38812e56782b2802d9f8a216c3; next sequenceid=15252 2014-08-20 19:51:38,531 INFO [PostOpenDeployTasks:647e9e38812e56782b2802d9f8a216c3] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 19:51:38,532 DEBUG [PostOpenDeployTasks:647e9e38812e56782b2802d9f8a216c3] master.AssignmentManager: Got transition OPENED for {647e9e38812e56782b2802d9f8a216c3 state=PENDING_OPEN, ts=1408564298322, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,532 INFO [PostOpenDeployTasks:647e9e38812e56782b2802d9f8a216c3] master.RegionStates: Transition {647e9e38812e56782b2802d9f8a216c3 state=PENDING_OPEN, ts=1408564298322, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {647e9e38812e56782b2802d9f8a216c3 state=OPEN, ts=1408564298532, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,532 INFO [PostOpenDeployTasks:647e9e38812e56782b2802d9f8a216c3] master.RegionStateStore: Updating row TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. with state=OPEN&openSeqNum=15252&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,533 INFO [StoreOpener-35556b0cd9ee4aeb9ccdef2e502703d1-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,534 INFO [StoreOpener-35556b0cd9ee4aeb9ccdef2e502703d1-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,534 DEBUG [ActiveMasterManager] client.ScannerCallableWithReplicas: Closing scanner 5 2014-08-20 19:51:38,534 INFO [PostOpenDeployTasks:647e9e38812e56782b2802d9f8a216c3] master.RegionStates: Onlined 647e9e38812e56782b2802d9f8a216c3 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,535 INFO [PostOpenDeployTasks:647e9e38812e56782b2802d9f8a216c3] master.RegionStates: Offlined 647e9e38812e56782b2802d9f8a216c3 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,535 DEBUG [PostOpenDeployTasks:647e9e38812e56782b2802d9f8a216c3] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 19:51:38,535 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] handler.OpenRegionHandler: Opened TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,536 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Opening region: {ENCODED => a0333fe1d1e09a008b55f6346d998370, NAME => 'TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370.', STARTKEY => '00000000000000000083886080', ENDKEY => '00000000000000000094371840'} 2014-08-20 19:51:38,537 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable a0333fe1d1e09a008b55f6346d998370 2014-08-20 19:51:38,538 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Instantiated TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 19:51:38,543 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper: Node /hbase/namespace/default already exists 2014-08-20 19:51:38,547 INFO [StoreOpener-a0333fe1d1e09a008b55f6346d998370-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,548 INFO [StoreOpener-a0333fe1d1e09a008b55f6346d998370-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,559 DEBUG [ActiveMasterManager] zookeeper.RecoverableZooKeeper: Node /hbase/namespace/hbase already exists 2014-08-20 19:51:38,568 INFO [ActiveMasterManager] master.HMaster: Master has completed initialization 2014-08-20 19:51:38,649 DEBUG [StoreOpener-484fab46de6b0ae27958354313d20b23-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/484fab46de6b0ae27958354313d20b23/info/bedc57942e564a2c96e29095c99230a9, isReference=false, isBulkLoadResult=false, seqid=15254, majorCompaction=true 2014-08-20 19:51:38,653 DEBUG [StoreOpener-35556b0cd9ee4aeb9ccdef2e502703d1-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/35556b0cd9ee4aeb9ccdef2e502703d1/info/0ef2cb47b95d466291e32e1934ae0b33, isReference=false, isBulkLoadResult=false, seqid=15253, majorCompaction=true 2014-08-20 19:51:38,655 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/484fab46de6b0ae27958354313d20b23 2014-08-20 19:51:38,655 DEBUG [StoreOpener-a0333fe1d1e09a008b55f6346d998370-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/a0333fe1d1e09a008b55f6346d998370/info/632da0e41eb2409385f70a8138618ffc, isReference=false, isBulkLoadResult=false, seqid=15253, majorCompaction=true 2014-08-20 19:51:38,656 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/35556b0cd9ee4aeb9ccdef2e502703d1 2014-08-20 19:51:38,657 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/a0333fe1d1e09a008b55f6346d998370 2014-08-20 19:51:38,659 INFO [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Onlined 484fab46de6b0ae27958354313d20b23; next sequenceid=15255 2014-08-20 19:51:38,661 INFO [PostOpenDeployTasks:484fab46de6b0ae27958354313d20b23] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 19:51:38,661 INFO [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Onlined 35556b0cd9ee4aeb9ccdef2e502703d1; next sequenceid=15254 2014-08-20 19:51:38,662 DEBUG [PostOpenDeployTasks:484fab46de6b0ae27958354313d20b23] master.AssignmentManager: Got transition OPENED for {484fab46de6b0ae27958354313d20b23 state=PENDING_OPEN, ts=1408564298324, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,662 INFO [PostOpenDeployTasks:484fab46de6b0ae27958354313d20b23] master.RegionStates: Transition {484fab46de6b0ae27958354313d20b23 state=PENDING_OPEN, ts=1408564298324, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {484fab46de6b0ae27958354313d20b23 state=OPEN, ts=1408564298662, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,662 INFO [PostOpenDeployTasks:484fab46de6b0ae27958354313d20b23] master.RegionStateStore: Updating row TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. with state=OPEN&openSeqNum=15255&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,664 INFO [PostOpenDeployTasks:35556b0cd9ee4aeb9ccdef2e502703d1] regionserver.HRegionServer: Post open deploy tasks for TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 19:51:38,665 DEBUG [PostOpenDeployTasks:35556b0cd9ee4aeb9ccdef2e502703d1] master.AssignmentManager: Got transition OPENED for {35556b0cd9ee4aeb9ccdef2e502703d1 state=PENDING_OPEN, ts=1408564298326, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,665 INFO [PostOpenDeployTasks:35556b0cd9ee4aeb9ccdef2e502703d1] master.RegionStates: Transition {35556b0cd9ee4aeb9ccdef2e502703d1 state=PENDING_OPEN, ts=1408564298326, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {35556b0cd9ee4aeb9ccdef2e502703d1 state=OPEN, ts=1408564298665, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,665 INFO [PostOpenDeployTasks:35556b0cd9ee4aeb9ccdef2e502703d1] master.RegionStateStore: Updating row TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. with state=OPEN&openSeqNum=15254&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,665 INFO [PostOpenDeployTasks:484fab46de6b0ae27958354313d20b23] master.RegionStates: Onlined 484fab46de6b0ae27958354313d20b23 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,666 INFO [PostOpenDeployTasks:484fab46de6b0ae27958354313d20b23] master.RegionStates: Offlined 484fab46de6b0ae27958354313d20b23 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,666 DEBUG [PostOpenDeployTasks:484fab46de6b0ae27958354313d20b23] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 19:51:38,666 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] handler.OpenRegionHandler: Opened TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,667 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Opening region: {ENCODED => 9b4e77649e34b8667cb655ed6788ae06, NAME => 'TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06.', STARTKEY => '00000000000000000062914560', ENDKEY => '00000000000000000073400320'} 2014-08-20 19:51:38,668 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable 9b4e77649e34b8667cb655ed6788ae06 2014-08-20 19:51:38,668 INFO [PostOpenDeployTasks:35556b0cd9ee4aeb9ccdef2e502703d1] master.RegionStates: Onlined 35556b0cd9ee4aeb9ccdef2e502703d1 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,668 INFO [PostOpenDeployTasks:35556b0cd9ee4aeb9ccdef2e502703d1] master.RegionStates: Offlined 35556b0cd9ee4aeb9ccdef2e502703d1 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,668 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Instantiated TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 19:51:38,668 DEBUG [PostOpenDeployTasks:35556b0cd9ee4aeb9ccdef2e502703d1] regionserver.HRegionServer: Finished post open deploy task for TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 19:51:38,668 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] handler.OpenRegionHandler: Opened TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,669 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Opening region: {ENCODED => 6246293acada9511ad1ed27a2c136b3d, NAME => 'TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d.', STARTKEY => '00000000000000000073400320', ENDKEY => '00000000000000000083886080'} 2014-08-20 19:51:38,670 INFO [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Onlined a0333fe1d1e09a008b55f6346d998370; next sequenceid=15254 2014-08-20 19:51:38,670 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable 6246293acada9511ad1ed27a2c136b3d 2014-08-20 19:51:38,670 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Instantiated TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 19:51:38,672 INFO [PostOpenDeployTasks:a0333fe1d1e09a008b55f6346d998370] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 19:51:38,672 DEBUG [PostOpenDeployTasks:a0333fe1d1e09a008b55f6346d998370] master.AssignmentManager: Got transition OPENED for {a0333fe1d1e09a008b55f6346d998370 state=PENDING_OPEN, ts=1408564298328, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,672 INFO [PostOpenDeployTasks:a0333fe1d1e09a008b55f6346d998370] master.RegionStates: Transition {a0333fe1d1e09a008b55f6346d998370 state=PENDING_OPEN, ts=1408564298328, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {a0333fe1d1e09a008b55f6346d998370 state=OPEN, ts=1408564298672, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,673 INFO [PostOpenDeployTasks:a0333fe1d1e09a008b55f6346d998370] master.RegionStateStore: Updating row TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. with state=OPEN&openSeqNum=15254&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,675 INFO [PostOpenDeployTasks:a0333fe1d1e09a008b55f6346d998370] master.RegionStates: Onlined a0333fe1d1e09a008b55f6346d998370 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,675 INFO [PostOpenDeployTasks:a0333fe1d1e09a008b55f6346d998370] master.RegionStates: Offlined a0333fe1d1e09a008b55f6346d998370 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,675 DEBUG [PostOpenDeployTasks:a0333fe1d1e09a008b55f6346d998370] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 19:51:38,675 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] handler.OpenRegionHandler: Opened TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,676 INFO [StoreOpener-9b4e77649e34b8667cb655ed6788ae06-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,676 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Opening region: {ENCODED => b67f1ed699b2b31d5360b0f8245839a6, NAME => 'TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6.', STARTKEY => '00000000000000000094371840', ENDKEY => ''} 2014-08-20 19:51:38,677 INFO [StoreOpener-9b4e77649e34b8667cb655ed6788ae06-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,677 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable b67f1ed699b2b31d5360b0f8245839a6 2014-08-20 19:51:38,678 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Instantiated TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 19:51:38,679 INFO [StoreOpener-6246293acada9511ad1ed27a2c136b3d-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,680 INFO [StoreOpener-6246293acada9511ad1ed27a2c136b3d-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,685 INFO [StoreOpener-b67f1ed699b2b31d5360b0f8245839a6-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,686 INFO [StoreOpener-b67f1ed699b2b31d5360b0f8245839a6-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,772 DEBUG [StoreOpener-6246293acada9511ad1ed27a2c136b3d-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/6246293acada9511ad1ed27a2c136b3d/info/4d1d670e4c634e118efb4189797b3d19, isReference=false, isBulkLoadResult=false, seqid=15242, majorCompaction=true 2014-08-20 19:51:38,772 DEBUG [StoreOpener-b67f1ed699b2b31d5360b0f8245839a6-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/b67f1ed699b2b31d5360b0f8245839a6/info/db2409656c94417381fc183e77f2a1d6, isReference=false, isBulkLoadResult=false, seqid=15254, majorCompaction=true 2014-08-20 19:51:38,776 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/b67f1ed699b2b31d5360b0f8245839a6 2014-08-20 19:51:38,776 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/6246293acada9511ad1ed27a2c136b3d 2014-08-20 19:51:38,780 INFO [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Onlined b67f1ed699b2b31d5360b0f8245839a6; next sequenceid=15255 2014-08-20 19:51:38,780 INFO [RS_OPEN_REGION-hor17n36:16020-1] regionserver.HRegion: Onlined 6246293acada9511ad1ed27a2c136b3d; next sequenceid=15243 2014-08-20 19:51:38,782 INFO [PostOpenDeployTasks:b67f1ed699b2b31d5360b0f8245839a6] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 19:51:38,782 INFO [PostOpenDeployTasks:6246293acada9511ad1ed27a2c136b3d] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 19:51:38,783 DEBUG [PostOpenDeployTasks:b67f1ed699b2b31d5360b0f8245839a6] master.AssignmentManager: Got transition OPENED for {b67f1ed699b2b31d5360b0f8245839a6 state=PENDING_OPEN, ts=1408564298333, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,783 DEBUG [PostOpenDeployTasks:6246293acada9511ad1ed27a2c136b3d] master.AssignmentManager: Got transition OPENED for {6246293acada9511ad1ed27a2c136b3d state=PENDING_OPEN, ts=1408564298331, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,783 INFO [PostOpenDeployTasks:b67f1ed699b2b31d5360b0f8245839a6] master.RegionStates: Transition {b67f1ed699b2b31d5360b0f8245839a6 state=PENDING_OPEN, ts=1408564298333, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {b67f1ed699b2b31d5360b0f8245839a6 state=OPEN, ts=1408564298783, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,783 INFO [PostOpenDeployTasks:6246293acada9511ad1ed27a2c136b3d] master.RegionStates: Transition {6246293acada9511ad1ed27a2c136b3d state=PENDING_OPEN, ts=1408564298331, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {6246293acada9511ad1ed27a2c136b3d state=OPEN, ts=1408564298783, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,784 INFO [PostOpenDeployTasks:b67f1ed699b2b31d5360b0f8245839a6] master.RegionStateStore: Updating row TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. with state=OPEN&openSeqNum=15255&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,784 INFO [PostOpenDeployTasks:6246293acada9511ad1ed27a2c136b3d] master.RegionStateStore: Updating row TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. with state=OPEN&openSeqNum=15243&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,787 INFO [PostOpenDeployTasks:b67f1ed699b2b31d5360b0f8245839a6] master.RegionStates: Onlined b67f1ed699b2b31d5360b0f8245839a6 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,787 DEBUG [StoreOpener-9b4e77649e34b8667cb655ed6788ae06-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/9b4e77649e34b8667cb655ed6788ae06/info/f40e16e772e24c20ad8a381e716b63a5, isReference=false, isBulkLoadResult=false, seqid=15260, majorCompaction=true 2014-08-20 19:51:38,787 INFO [PostOpenDeployTasks:b67f1ed699b2b31d5360b0f8245839a6] master.RegionStates: Offlined b67f1ed699b2b31d5360b0f8245839a6 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,787 INFO [PostOpenDeployTasks:6246293acada9511ad1ed27a2c136b3d] master.RegionStates: Onlined 6246293acada9511ad1ed27a2c136b3d on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,787 DEBUG [PostOpenDeployTasks:b67f1ed699b2b31d5360b0f8245839a6] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 19:51:38,788 INFO [PostOpenDeployTasks:6246293acada9511ad1ed27a2c136b3d] master.RegionStates: Offlined 6246293acada9511ad1ed27a2c136b3d from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,788 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] handler.OpenRegionHandler: Opened TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,788 DEBUG [PostOpenDeployTasks:6246293acada9511ad1ed27a2c136b3d] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 19:51:38,790 DEBUG [RS_OPEN_REGION-hor17n36:16020-1] handler.OpenRegionHandler: Opened TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,790 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Opening region: {ENCODED => df92c867f561868284729e0deeb615ce, NAME => 'TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce.', STARTKEY => '00000000000000000020971520', ENDKEY => '00000000000000000031457280'} 2014-08-20 19:51:38,791 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/9b4e77649e34b8667cb655ed6788ae06 2014-08-20 19:51:38,791 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table TestTable df92c867f561868284729e0deeb615ce 2014-08-20 19:51:38,791 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Instantiated TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 19:51:38,795 INFO [RS_OPEN_REGION-hor17n36:16020-2] regionserver.HRegion: Onlined 9b4e77649e34b8667cb655ed6788ae06; next sequenceid=15261 2014-08-20 19:51:38,796 INFO [StoreOpener-df92c867f561868284729e0deeb615ce-1] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:38,797 INFO [PostOpenDeployTasks:9b4e77649e34b8667cb655ed6788ae06] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 19:51:38,797 INFO [StoreOpener-df92c867f561868284729e0deeb615ce-1] compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2560; major period 86400000, major jitter 0.500000 2014-08-20 19:51:38,797 DEBUG [PostOpenDeployTasks:9b4e77649e34b8667cb655ed6788ae06] master.AssignmentManager: Got transition OPENED for {9b4e77649e34b8667cb655ed6788ae06 state=PENDING_OPEN, ts=1408564298329, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,798 INFO [PostOpenDeployTasks:9b4e77649e34b8667cb655ed6788ae06] master.RegionStates: Transition {9b4e77649e34b8667cb655ed6788ae06 state=PENDING_OPEN, ts=1408564298329, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {9b4e77649e34b8667cb655ed6788ae06 state=OPEN, ts=1408564298798, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,798 INFO [PostOpenDeployTasks:9b4e77649e34b8667cb655ed6788ae06] master.RegionStateStore: Updating row TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. with state=OPEN&openSeqNum=15261&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,799 INFO [PostOpenDeployTasks:9b4e77649e34b8667cb655ed6788ae06] master.RegionStates: Onlined 9b4e77649e34b8667cb655ed6788ae06 on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,800 INFO [PostOpenDeployTasks:9b4e77649e34b8667cb655ed6788ae06] master.RegionStates: Offlined 9b4e77649e34b8667cb655ed6788ae06 from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,800 DEBUG [PostOpenDeployTasks:9b4e77649e34b8667cb655ed6788ae06] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 19:51:38,800 DEBUG [RS_OPEN_REGION-hor17n36:16020-2] handler.OpenRegionHandler: Opened TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,908 DEBUG [StoreOpener-df92c867f561868284729e0deeb615ce-1] regionserver.HStore: loaded hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/df92c867f561868284729e0deeb615ce/info/56cadf38752a43d0864f4df68e881471, isReference=false, isBulkLoadResult=false, seqid=15256, majorCompaction=true 2014-08-20 19:51:38,911 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/default/TestTable/df92c867f561868284729e0deeb615ce 2014-08-20 19:51:38,914 INFO [RS_OPEN_REGION-hor17n36:16020-0] regionserver.HRegion: Onlined df92c867f561868284729e0deeb615ce; next sequenceid=15257 2014-08-20 19:51:38,917 INFO [PostOpenDeployTasks:df92c867f561868284729e0deeb615ce] regionserver.HRegionServer: Post open deploy tasks for TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 19:51:38,917 DEBUG [PostOpenDeployTasks:df92c867f561868284729e0deeb615ce] master.AssignmentManager: Got transition OPENED for {df92c867f561868284729e0deeb615ce state=PENDING_OPEN, ts=1408564298335, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} from hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,917 INFO [PostOpenDeployTasks:df92c867f561868284729e0deeb615ce] master.RegionStates: Transition {df92c867f561868284729e0deeb615ce state=PENDING_OPEN, ts=1408564298335, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} to {df92c867f561868284729e0deeb615ce state=OPEN, ts=1408564298917, server=hor17n36.gq1.ygridcore.net,16020,1408564290615} 2014-08-20 19:51:38,917 INFO [PostOpenDeployTasks:df92c867f561868284729e0deeb615ce] master.RegionStateStore: Updating row TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. with state=OPEN&openSeqNum=15257&server=hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,920 INFO [PostOpenDeployTasks:df92c867f561868284729e0deeb615ce] master.RegionStates: Onlined df92c867f561868284729e0deeb615ce on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:38,920 INFO [PostOpenDeployTasks:df92c867f561868284729e0deeb615ce] master.RegionStates: Offlined df92c867f561868284729e0deeb615ce from hor17n36.gq1.ygridcore.net,16020,1408554989900 2014-08-20 19:51:38,920 DEBUG [PostOpenDeployTasks:df92c867f561868284729e0deeb615ce] regionserver.HRegionServer: Finished post open deploy task for TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 19:51:38,920 DEBUG [RS_OPEN_REGION-hor17n36:16020-0] handler.OpenRegionHandler: Opened TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. on hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 19:51:40,816 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.62 MB 2014-08-20 19:51:43,250 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@8714de2 because one (major) compacted file only and oldestTime 1391092211ms is < ttl=9223372036854775807 2014-08-20 19:51:43,250 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@5a57d0cf because one (major) compacted file only and oldestTime 1387385301ms is < ttl=9223372036854775807 2014-08-20 19:51:43,251 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@7ae6a763 because one (major) compacted file only and oldestTime 1390612650ms is < ttl=9223372036854775807 2014-08-20 19:51:43,252 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@21fc8957 because one (major) compacted file only and oldestTime 1389840582ms is < ttl=9223372036854775807 2014-08-20 19:51:43,252 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@790d73ed because one (major) compacted file only and oldestTime 1388306453ms is < ttl=9223372036854775807 2014-08-20 19:51:43,253 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@49f81cd6 because one (major) compacted file only and oldestTime 1389057995ms is < ttl=9223372036854775807 2014-08-20 19:51:43,253 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@5dba71f0 because one (major) compacted file only and oldestTime 1390229920ms is < ttl=9223372036854775807 2014-08-20 19:51:43,253 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@7b8e73a2; time since last major compaction 173558168ms 2014-08-20 19:51:43,254 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Selecting compaction from 2 store files, 0 compacting, 2 eligible, 10 blocking 2014-08-20 19:51:43,254 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Major compaction triggered on store org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@7b8e73a2; time since last major compaction 173558169ms 2014-08-20 19:51:43,257 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] regionserver.HStore: 1588230740 - info: Initiating major compaction (all files) 2014-08-20 19:51:43,259 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] regionserver.CompactSplitThread: Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@45fdc3bd; Because: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker requests major compaction; use default priority; compaction_queue=(0:0), split_queue=0, merge_queue=0 2014-08-20 19:51:43,259 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@5b70f3e2 because one (major) compacted file only and oldestTime 1388645607ms is < ttl=9223372036854775807 2014-08-20 19:51:43,260 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@3789f531 because one (major) compacted file only and oldestTime 1389411078ms is < ttl=9223372036854775807 2014-08-20 19:51:43,260 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] regionserver.HRegion: Starting compaction on info in region hbase:meta,,1.1588230740 2014-08-20 19:51:43,260 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] compactions.RatioBasedCompactionPolicy: Skipping major compaction of org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy@18b12000 because one (major) compacted file only and oldestTime 1387774877ms is < ttl=9223372036854775807 2014-08-20 19:51:43,260 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] regionserver.HStore: Starting compaction of 2 file(s) in info of hbase:meta,,1.1588230740 into tmpdir=hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/.tmp, totalSize=94.1 K 2014-08-20 19:51:43,262 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] compactions.Compactor: Compacting hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/07e7b86441fb4b8996905bc66608c5e3, keycount=561, bloomtype=NONE, size=80.5 K, encoding=NONE, seqNum=75461, earliestPutTs=1406162326140 2014-08-20 19:51:43,262 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] compactions.Compactor: Compacting hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/edaee66bbec84210bf8deb94f63a7b3c, keycount=66, bloomtype=NONE, size=13.6 K, encoding=NONE, seqNum=75508, earliestPutTs=1408554997503 2014-08-20 19:51:43,263 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] hfile.CacheConfig: blockCache=LruBlockCache{blockCount=14, currentSize=13237928, freeSize=12803637592, maxSize=12816875520, heapSize=13237928, minSize=12176031744, minFactor=0.95, multiSize=6088015872, multiFactor=0.5, singleSize=3044007936, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=true, prefetchOnOpen=false 2014-08-20 19:51:43,512 WARN [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 19:51:43,516 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] regionserver.HRegionFileSystem: Committing store file hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/.tmp/1320fd66f78a4e1297a0659ce3b49292 as hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/1320fd66f78a4e1297a0659ce3b49292 2014-08-20 19:51:43,540 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] regionserver.HStore: Removing store files after compaction... 2014-08-20 19:51:43,580 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/07e7b86441fb4b8996905bc66608c5e3, to hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/archive/data/hbase/meta/1588230740/info/07e7b86441fb4b8996905bc66608c5e3 2014-08-20 19:51:43,589 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] backup.HFileArchiver: Finished archiving from class org.apache.hadoop.hbase.backup.HFileArchiver$FileableStoreFile, file:hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/edaee66bbec84210bf8deb94f63a7b3c, to hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/archive/data/hbase/meta/1588230740/info/edaee66bbec84210bf8deb94f63a7b3c 2014-08-20 19:51:43,589 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] regionserver.HStore: Completed major compaction of 2 (all) file(s) in info of hbase:meta,,1.1588230740 into 1320fd66f78a4e1297a0659ce3b49292(size=79.5 K), total size for store is 79.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2014-08-20 19:51:43,592 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] regionserver.CompactSplitThread: Completed compaction: Request = regionName=hbase:meta,,1.1588230740, storeName=info, fileCount=2, fileSize=94.1 K, priority=8, time=47224483693327974; duration=0sec 2014-08-20 19:51:43,592 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-shortCompactions-1408564303258] regionserver.CompactSplitThread: CompactSplitThread Status: compaction_queue=(0:0), split_queue=0, merge_queue=0 2014-08-20 19:51:50,817 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:51:52,799 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615.splitLogManagerTimeoutMonitor] master.SplitLogManager: Garbage collecting all recovering region znodes 2014-08-20 19:52:00,818 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:52:10,818 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:52:20,819 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:52:30,820 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:52:32,973 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] master.ReplicationLogCleaner: Didn't find this log in ZK, deleting: hor17n36.gq1.ygridcore.net%2C16020%2C1408554989900.1408562194548 2014-08-20 19:52:32,998 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] master.ReplicationLogCleaner: Didn't find this log in ZK, deleting: hor17n36.gq1.ygridcore.net%2C16020%2C1408554989900.1408562198602.meta 2014-08-20 19:52:40,820 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:52:50,821 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:53:00,821 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:53:10,822 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:53:20,823 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:53:30,823 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:53:37,751 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 19:53:37,753 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 19:53:37,753 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 19:53:37,753 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:41634 because read count=-1. Number of active connections: 2 2014-08-20 19:53:37,753 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 1 2014-08-20 19:53:38,562 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 19:53:38,562 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 19:53:38,562 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:41636 because read count=-1. Number of active connections: 1 2014-08-20 19:53:38,562 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 19:53:38,562 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 19:53:40,824 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:53:50,824 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:54:00,825 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:54:10,826 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:54:20,826 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:54:30,827 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:54:40,827 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:54:50,828 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:55:00,829 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:55:10,829 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:55:20,830 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:55:30,830 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:55:40,831 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:55:50,832 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:56:00,832 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:56:10,833 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:56:20,833 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:56:30,818 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=12.54 MB, freeSize=11.92 GB, max=11.94 GB, blockCount=2, accesses=56, hits=42, hitRatio=75.00%, , cachingAccesses=44, cachingHits=30, cachingHitsRatio=68.18%, evictions=29, evicted=12, evictedPerRun=0.4137931168079376 2014-08-20 19:56:30,834 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.54 MB 2014-08-20 19:56:38,450 DEBUG [htable-pool10-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 19:56:38,450 DEBUG [htable-pool10-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 19:56:38,451 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:41840; # active connections: 1 2014-08-20 19:56:38,451 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 19:56:38,483 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 6 2014-08-20 19:56:38,955 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 19:56:40,835 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:56:50,835 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:57:00,836 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:57:10,836 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:57:20,837 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:57:30,837 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:57:40,838 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:57:50,839 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:58:00,839 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:58:10,840 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:58:20,840 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:58:30,841 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:58:38,500 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 19:58:38,501 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 19:58:38,501 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:41840 because read count=-1. Number of active connections: 1 2014-08-20 19:58:38,501 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 19:58:38,501 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 19:58:40,842 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:58:50,842 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:59:00,843 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:59:10,843 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:59:20,844 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:59:30,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:59:40,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 19:59:50,846 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:00:00,846 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:00:10,847 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:00:20,847 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:00:30,848 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:00:40,849 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:00:50,849 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:01:00,850 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:01:10,850 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:01:20,851 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:01:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=12.61 MB, freeSize=11.92 GB, max=11.94 GB, blockCount=12, accesses=66, hits=42, hitRatio=63.64%, , cachingAccesses=54, cachingHits=30, cachingHitsRatio=55.56%, evictions=59, evicted=12, evictedPerRun=0.20338982343673706 2014-08-20 20:01:30,851 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:01:38,448 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:01:38,449 DEBUG [htable-pool11-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:01:38,449 DEBUG [htable-pool11-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:01:38,450 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:42044; # active connections: 1 2014-08-20 20:01:38,452 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:01:38,474 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 7 2014-08-20 20:01:40,852 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:01:50,853 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:02:00,853 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:02:10,854 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:02:20,854 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:02:30,855 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:02:40,855 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:02:50,856 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:03:00,857 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:03:10,857 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:03:20,858 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:03:30,859 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:03:38,498 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:03:38,498 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:03:38,498 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:03:38,498 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:42044 because read count=-1. Number of active connections: 1 2014-08-20 20:03:38,498 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:03:40,859 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:03:50,860 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:04:00,860 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:04:10,861 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:04:20,862 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:04:30,862 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:04:40,863 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:04:50,863 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:05:00,864 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:05:10,864 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:05:20,865 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:05:30,866 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:05:40,866 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:05:50,867 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:06:00,868 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:06:10,868 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:06:20,869 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:06:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=12.61 MB, freeSize=11.92 GB, max=11.94 GB, blockCount=12, accesses=76, hits=52, hitRatio=68.42%, , cachingAccesses=64, cachingHits=40, cachingHitsRatio=62.50%, evictions=89, evicted=12, evictedPerRun=0.13483145833015442 2014-08-20 20:06:30,869 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:06:38,448 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:06:38,450 DEBUG [htable-pool12-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:06:38,450 DEBUG [htable-pool12-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:06:38,452 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:42251; # active connections: 1 2014-08-20 20:06:38,453 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:06:38,475 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 8 2014-08-20 20:06:40,870 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:06:50,870 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.33 GB of total=12.61 MB 2014-08-20 20:06:52,173 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51922; # active connections: 2 2014-08-20 20:06:52,251 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51923; # active connections: 3 2014-08-20 20:06:52,347 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51922 because read count=-1. Number of active connections: 3 2014-08-20 20:06:52,347 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51923 because read count=-1. Number of active connections: 2 2014-08-20 20:06:52,662 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51936; # active connections: 2 2014-08-20 20:06:52,662 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51935; # active connections: 3 2014-08-20 20:06:52,671 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51939; # active connections: 4 2014-08-20 20:06:52,671 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51938; # active connections: 5 2014-08-20 20:06:52,673 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51941; # active connections: 6 2014-08-20 20:06:52,674 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51942; # active connections: 7 2014-08-20 20:06:52,674 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51943; # active connections: 8 2014-08-20 20:06:52,674 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51944; # active connections: 9 2014-08-20 20:06:52,675 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51946; # active connections: 10 2014-08-20 20:06:52,675 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:51945; # active connections: 11 2014-08-20 20:06:53,605 INFO [defaultRpcServer.handler=49,queue=1,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:06:53,605 INFO [defaultRpcServer.handler=28,queue=4,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:07:00,871 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.22 GB of total=124.26 MB 2014-08-20 20:07:10,871 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.16 GB of total=182.01 MB 2014-08-20 20:07:20,872 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.10 GB of total=242.81 MB 2014-08-20 20:07:24,208 INFO [defaultRpcServer.handler=24,queue=0,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:07:30,872 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -11.04 GB of total=309.21 MB 2014-08-20 20:07:40,873 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.97 GB of total=382.02 MB 2014-08-20 20:07:50,873 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.89 GB of total=461.58 MB 2014-08-20 20:08:00,874 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.81 GB of total=544.76 MB 2014-08-20 20:08:02,988 INFO [defaultRpcServer.handler=39,queue=3,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:08:10,874 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.71 GB of total=640.16 MB 2014-08-20 20:08:20,875 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.62 GB of total=741.99 MB 2014-08-20 20:08:30,876 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.49 GB of total=866.05 MB 2014-08-20 20:08:38,504 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:08:38,504 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:08:38,504 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:08:38,504 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:08:38,504 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:42251 because read count=-1. Number of active connections: 11 2014-08-20 20:08:40,876 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.35 GB of total=1009.57 MB 2014-08-20 20:08:50,877 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.19 GB of total=1.15 GB 2014-08-20 20:09:00,877 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -10.01 GB of total=1.33 GB 2014-08-20 20:09:10,878 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -9.76 GB of total=1.58 GB 2014-08-20 20:09:20,878 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -9.42 GB of total=1.92 GB 2014-08-20 20:09:25,222 INFO [defaultRpcServer.handler=53,queue=5,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:09:25,222 INFO [defaultRpcServer.handler=51,queue=3,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:09:30,879 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -8.93 GB of total=2.41 GB 2014-08-20 20:09:40,879 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -8.28 GB of total=3.06 GB 2014-08-20 20:09:47,540 INFO [defaultRpcServer.handler=34,queue=4,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:09:50,880 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.59 GB of total=3.75 GB 2014-08-20 20:10:00,890 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -6.93 GB of total=4.41 GB 2014-08-20 20:10:10,904 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -6.32 GB of total=5.02 GB 2014-08-20 20:10:20,916 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -5.75 GB of total=5.59 GB 2014-08-20 20:10:30,916 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -5.23 GB of total=6.11 GB 2014-08-20 20:10:40,927 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -4.76 GB of total=6.58 GB 2014-08-20 20:10:50,928 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -4.35 GB of total=6.99 GB 2014-08-20 20:11:00,940 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -3.96 GB of total=7.38 GB 2014-08-20 20:11:10,948 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -3.61 GB of total=7.73 GB 2014-08-20 20:11:20,949 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -3.28 GB of total=8.06 GB 2014-08-20 20:11:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=8.36 GB, freeSize=3.58 GB, max=11.94 GB, blockCount=530285, accesses=2762505, hits=2232193, hitRatio=80.80%, , cachingAccesses=2762504, cachingHits=2232194, cachingHitsRatio=80.80%, evictions=119, evicted=12, evictedPerRun=0.10084033757448196 2014-08-20 20:11:30,950 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.98 GB of total=8.36 GB 2014-08-20 20:11:38,494 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:11:38,495 DEBUG [htable-pool13-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:11:38,495 DEBUG [htable-pool13-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:11:38,495 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:42461; # active connections: 11 2014-08-20 20:11:38,497 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:11:38,508 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 61 2014-08-20 20:11:40,950 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.74 GB of total=8.60 GB 2014-08-20 20:11:50,951 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.52 GB of total=8.82 GB 2014-08-20 20:12:00,951 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.33 GB of total=9.01 GB 2014-08-20 20:12:10,974 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.17 GB of total=9.17 GB 2014-08-20 20:12:16,236 INFO [defaultRpcServer.handler=18,queue=0,port=16020] compress.CodecPool: Got brand-new decompressor [.snappy] 2014-08-20 20:12:20,982 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.04 GB of total=9.30 GB 2014-08-20 20:12:31,006 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.91 GB of total=9.43 GB 2014-08-20 20:12:41,026 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.80 GB of total=9.54 GB 2014-08-20 20:12:51,027 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.69 GB of total=9.65 GB 2014-08-20 20:13:01,027 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.59 GB of total=9.75 GB 2014-08-20 20:13:11,028 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.49 GB of total=9.85 GB 2014-08-20 20:13:21,045 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.39 GB of total=9.95 GB 2014-08-20 20:13:31,056 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.30 GB of total=10.04 GB 2014-08-20 20:13:39,017 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:13:39,017 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:13:39,017 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:13:39,017 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:13:39,017 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:42461 because read count=-1. Number of active connections: 11 2014-08-20 20:13:41,067 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.21 GB of total=10.13 GB 2014-08-20 20:13:51,068 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.13 GB of total=10.21 GB 2014-08-20 20:14:01,069 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -1.05 GB of total=10.29 GB 2014-08-20 20:14:11,109 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -996.36 MB of total=10.37 GB 2014-08-20 20:14:21,110 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -924.79 MB of total=10.44 GB 2014-08-20 20:14:31,110 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -856.92 MB of total=10.50 GB 2014-08-20 20:14:41,114 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -791.89 MB of total=10.57 GB 2014-08-20 20:14:51,158 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -730.42 MB of total=10.63 GB 2014-08-20 20:15:01,159 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -670.55 MB of total=10.68 GB 2014-08-20 20:15:11,178 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -615.19 MB of total=10.74 GB 2014-08-20 20:15:21,178 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -560.31 MB of total=10.79 GB 2014-08-20 20:15:31,179 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -506.42 MB of total=10.85 GB 2014-08-20 20:15:41,179 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -456.22 MB of total=10.89 GB 2014-08-20 20:15:51,180 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -406.63 MB of total=10.94 GB 2014-08-20 20:16:01,180 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -358.15 MB of total=10.99 GB 2014-08-20 20:16:11,181 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -312.30 MB of total=11.03 GB 2014-08-20 20:16:21,181 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -267.34 MB of total=11.08 GB 2014-08-20 20:16:30,834 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.12 GB, freeSize=837.47 MB, max=11.94 GB, blockCount=707420, accesses=6450982, hits=5743529, hitRatio=89.03%, , cachingAccesses=6450970, cachingHits=5743517, cachingHitsRatio=89.03%, evictions=149, evicted=12, evictedPerRun=0.08053690940141678 2014-08-20 20:16:31,195 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -224.93 MB of total=11.12 GB 2014-08-20 20:16:38,494 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:16:38,495 DEBUG [htable-pool14-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:16:38,495 DEBUG [htable-pool14-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:16:38,496 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:42668; # active connections: 11 2014-08-20 20:16:38,496 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:16:38,504 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 62 2014-08-20 20:16:41,195 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -183.79 MB of total=11.16 GB 2014-08-20 20:16:51,203 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -147.92 MB of total=11.20 GB 2014-08-20 20:17:01,208 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -113.30 MB of total=11.23 GB 2014-08-20 20:17:11,208 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -80.23 MB of total=11.26 GB 2014-08-20 20:17:21,209 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -47.65 MB of total=11.29 GB 2014-08-20 20:17:31,209 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -17.65 MB of total=11.32 GB 2014-08-20 20:17:41,225 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 12.24 MB of total=11.35 GB 2014-08-20 20:17:42,035 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 12.24 MB from BlockBucket{name=multi, totalSize=9.93 GB, bucketSize=5.67 GB} 2014-08-20 20:17:42,078 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=12.26 MB, total=11.34 GB, single=1.41 GB, multi=9.93 GB, memory=81.20 KB 2014-08-20 20:17:52,078 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 31.32 MB of total=11.37 GB 2014-08-20 20:17:52,461 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 31.32 MB from BlockBucket{name=multi, totalSize=10.01 GB, bucketSize=5.67 GB} 2014-08-20 20:17:52,476 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=31.32 MB, total=11.34 GB, single=1.35 GB, multi=10.01 GB, memory=81.20 KB 2014-08-20 20:18:02,477 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.33 MB of total=11.37 GB 2014-08-20 20:18:02,755 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.33 MB from BlockBucket{name=multi, totalSize=10.07 GB, bucketSize=5.67 GB} 2014-08-20 20:18:02,768 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.35 MB, total=11.34 GB, single=1.29 GB, multi=10.07 GB, memory=81.20 KB 2014-08-20 20:18:12,768 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.53 MB of total=11.37 GB 2014-08-20 20:18:13,059 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.53 MB from BlockBucket{name=multi, totalSize=10.12 GB, bucketSize=5.67 GB} 2014-08-20 20:18:13,073 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.54 MB, total=11.34 GB, single=1.23 GB, multi=10.12 GB, memory=81.20 KB 2014-08-20 20:18:23,073 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.06 MB of total=11.37 GB 2014-08-20 20:18:23,331 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.06 MB from BlockBucket{name=multi, totalSize=10.18 GB, bucketSize=5.67 GB} 2014-08-20 20:18:23,372 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.07 MB, total=11.34 GB, single=1.18 GB, multi=10.18 GB, memory=81.20 KB 2014-08-20 20:18:33,382 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.98 MB of total=11.37 GB 2014-08-20 20:18:33,638 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.98 MB from BlockBucket{name=multi, totalSize=10.22 GB, bucketSize=5.67 GB} 2014-08-20 20:18:33,650 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.98 MB, total=11.34 GB, single=1.13 GB, multi=10.22 GB, memory=81.20 KB 2014-08-20 20:18:39,396 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:18:39,396 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:18:39,396 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:42668 because read count=-1. Number of active connections: 11 2014-08-20 20:18:39,396 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:18:39,396 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:18:43,651 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.33 MB of total=11.37 GB 2014-08-20 20:18:43,905 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.33 MB from BlockBucket{name=multi, totalSize=10.27 GB, bucketSize=5.67 GB} 2014-08-20 20:18:43,917 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.33 MB, total=11.34 GB, single=1.09 GB, multi=10.27 GB, memory=81.20 KB 2014-08-20 20:18:53,918 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.67 MB of total=11.37 GB 2014-08-20 20:18:54,209 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.67 MB from BlockBucket{name=multi, totalSize=10.31 GB, bucketSize=5.67 GB} 2014-08-20 20:18:54,223 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.67 MB, total=11.34 GB, single=1.04 GB, multi=10.31 GB, memory=81.20 KB 2014-08-20 20:19:04,235 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.09 MB of total=11.37 GB 2014-08-20 20:19:04,483 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.09 MB from BlockBucket{name=multi, totalSize=10.35 GB, bucketSize=5.67 GB} 2014-08-20 20:19:04,495 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.09 MB, total=11.34 GB, single=1.00 GB, multi=10.35 GB, memory=81.20 KB 2014-08-20 20:19:14,511 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.84 MB of total=11.37 GB 2014-08-20 20:19:14,775 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.84 MB from BlockBucket{name=multi, totalSize=10.39 GB, bucketSize=5.67 GB} 2014-08-20 20:19:14,781 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.84 MB, total=11.34 GB, single=988.20 MB, multi=10.39 GB, memory=81.20 KB 2014-08-20 20:19:24,781 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.14 MB of total=11.37 GB 2014-08-20 20:19:25,042 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.14 MB from BlockBucket{name=multi, totalSize=10.43 GB, bucketSize=5.67 GB} 2014-08-20 20:19:25,046 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.15 MB, total=11.34 GB, single=950.68 MB, multi=10.43 GB, memory=81.20 KB 2014-08-20 20:19:35,076 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.75 MB of total=11.37 GB 2014-08-20 20:19:35,335 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.75 MB from BlockBucket{name=multi, totalSize=10.46 GB, bucketSize=5.67 GB} 2014-08-20 20:19:35,338 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.76 MB, total=11.34 GB, single=916.87 MB, multi=10.46 GB, memory=81.20 KB 2014-08-20 20:19:45,338 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.99 MB of total=11.37 GB 2014-08-20 20:19:45,635 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.99 MB from BlockBucket{name=multi, totalSize=10.49 GB, bucketSize=5.67 GB} 2014-08-20 20:19:45,638 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.00 MB, total=11.34 GB, single=886.90 MB, multi=10.49 GB, memory=81.20 KB 2014-08-20 20:19:55,638 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.12 MB of total=11.37 GB 2014-08-20 20:19:55,932 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.12 MB from BlockBucket{name=multi, totalSize=10.52 GB, bucketSize=5.67 GB} 2014-08-20 20:19:55,935 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.13 MB, total=11.34 GB, single=859.47 MB, multi=10.52 GB, memory=81.20 KB 2014-08-20 20:20:05,941 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.84 MB of total=11.37 GB 2014-08-20 20:20:06,194 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.84 MB from BlockBucket{name=multi, totalSize=10.54 GB, bucketSize=5.67 GB} 2014-08-20 20:20:06,198 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.84 MB, total=11.34 GB, single=832.60 MB, multi=10.54 GB, memory=81.20 KB 2014-08-20 20:20:16,198 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.52 MB of total=11.37 GB 2014-08-20 20:20:16,494 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.52 MB from BlockBucket{name=multi, totalSize=10.57 GB, bucketSize=5.67 GB} 2014-08-20 20:20:16,497 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.53 MB, total=11.34 GB, single=806.10 MB, multi=10.57 GB, memory=81.20 KB 2014-08-20 20:20:26,519 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.44 MB of total=11.37 GB 2014-08-20 20:20:26,725 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.44 MB from BlockBucket{name=multi, totalSize=10.59 GB, bucketSize=5.67 GB} 2014-08-20 20:20:26,728 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.45 MB, total=11.34 GB, single=783.29 MB, multi=10.59 GB, memory=81.20 KB 2014-08-20 20:20:36,738 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.09 MB of total=11.37 GB 2014-08-20 20:20:36,954 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.09 MB from BlockBucket{name=multi, totalSize=10.61 GB, bucketSize=5.67 GB} 2014-08-20 20:20:36,985 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.10 MB, total=11.34 GB, single=761.85 MB, multi=10.61 GB, memory=81.20 KB 2014-08-20 20:20:46,986 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.53 MB of total=11.37 GB 2014-08-20 20:20:47,231 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.53 MB from BlockBucket{name=multi, totalSize=10.63 GB, bucketSize=5.67 GB} 2014-08-20 20:20:47,234 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.54 MB, total=11.34 GB, single=744.06 MB, multi=10.63 GB, memory=81.20 KB 2014-08-20 20:20:57,255 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.12 MB of total=11.37 GB 2014-08-20 20:20:57,469 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.12 MB from BlockBucket{name=multi, totalSize=10.65 GB, bucketSize=5.67 GB} 2014-08-20 20:20:57,471 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.13 MB, total=11.34 GB, single=724.07 MB, multi=10.65 GB, memory=81.20 KB 2014-08-20 20:21:07,472 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.99 MB of total=11.37 GB 2014-08-20 20:21:07,674 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.99 MB from BlockBucket{name=multi, totalSize=10.67 GB, bucketSize=5.67 GB} 2014-08-20 20:21:07,677 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.00 MB, total=11.34 GB, single=706.61 MB, multi=10.67 GB, memory=81.20 KB 2014-08-20 20:21:17,687 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.76 MB of total=11.37 GB 2014-08-20 20:21:17,888 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.76 MB from BlockBucket{name=multi, totalSize=10.68 GB, bucketSize=5.67 GB} 2014-08-20 20:21:17,891 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.76 MB, total=11.34 GB, single=690.04 MB, multi=10.68 GB, memory=81.20 KB 2014-08-20 20:21:27,911 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.54 MB of total=11.37 GB 2014-08-20 20:21:28,123 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.54 MB from BlockBucket{name=multi, totalSize=10.70 GB, bucketSize=5.67 GB} 2014-08-20 20:21:28,126 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.54 MB, total=11.34 GB, single=674.69 MB, multi=10.70 GB, memory=81.20 KB 2014-08-20 20:21:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=603.40 MB, max=11.94 GB, blockCount=722080, accesses=10731771, hits=9969215, hitRatio=92.89%, , cachingAccesses=10731760, cachingHits=9969205, cachingHitsRatio=92.89%, evictions=179, evicted=40444, evictedPerRun=225.9441375732422 2014-08-20 20:21:38,133 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.86 MB of total=11.37 GB 2014-08-20 20:21:38,340 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.86 MB from BlockBucket{name=multi, totalSize=10.71 GB, bucketSize=5.67 GB} 2014-08-20 20:21:38,342 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.87 MB, total=11.34 GB, single=659.97 MB, multi=10.71 GB, memory=81.20 KB 2014-08-20 20:21:38,512 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:21:38,612 DEBUG [htable-pool15-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:21:38,612 DEBUG [htable-pool15-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:21:38,613 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:42883; # active connections: 11 2014-08-20 20:21:38,613 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:21:38,618 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 63 2014-08-20 20:21:48,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.46 MB of total=11.37 GB 2014-08-20 20:21:48,546 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.46 MB from BlockBucket{name=multi, totalSize=10.72 GB, bucketSize=5.67 GB} 2014-08-20 20:21:48,549 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.46 MB, total=11.34 GB, single=646.21 MB, multi=10.72 GB, memory=81.20 KB 2014-08-20 20:21:58,549 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.73 MB of total=11.37 GB 2014-08-20 20:21:58,787 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.73 MB from BlockBucket{name=multi, totalSize=10.74 GB, bucketSize=5.67 GB} 2014-08-20 20:21:58,789 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.73 MB, total=11.34 GB, single=632.90 MB, multi=10.74 GB, memory=81.20 KB 2014-08-20 20:22:08,790 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.85 MB of total=11.37 GB 2014-08-20 20:22:09,053 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.85 MB from BlockBucket{name=multi, totalSize=10.75 GB, bucketSize=5.67 GB} 2014-08-20 20:22:09,055 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.85 MB, total=11.34 GB, single=620.24 MB, multi=10.75 GB, memory=81.20 KB 2014-08-20 20:22:19,056 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 26.89 MB of total=11.37 GB 2014-08-20 20:22:19,227 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 26.89 MB from BlockBucket{name=multi, totalSize=10.76 GB, bucketSize=5.67 GB} 2014-08-20 20:22:19,259 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=26.90 MB, total=11.34 GB, single=607.68 MB, multi=10.76 GB, memory=81.20 KB 2014-08-20 20:22:29,286 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.95 MB of total=11.37 GB 2014-08-20 20:22:29,491 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.95 MB from BlockBucket{name=multi, totalSize=10.77 GB, bucketSize=5.67 GB} 2014-08-20 20:22:29,494 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.96 MB, total=11.34 GB, single=597.09 MB, multi=10.77 GB, memory=81.20 KB 2014-08-20 20:22:39,511 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.42 MB of total=11.37 GB 2014-08-20 20:22:39,711 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.42 MB from BlockBucket{name=multi, totalSize=10.78 GB, bucketSize=5.67 GB} 2014-08-20 20:22:39,713 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.43 MB, total=11.34 GB, single=587.12 MB, multi=10.78 GB, memory=81.20 KB 2014-08-20 20:22:49,714 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.31 MB of total=11.37 GB 2014-08-20 20:22:49,917 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.31 MB from BlockBucket{name=multi, totalSize=10.79 GB, bucketSize=5.67 GB} 2014-08-20 20:22:49,919 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.32 MB, total=11.34 GB, single=577.06 MB, multi=10.79 GB, memory=81.20 KB 2014-08-20 20:23:00,013 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.60 MB of total=11.37 GB 2014-08-20 20:23:00,216 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.60 MB from BlockBucket{name=multi, totalSize=10.80 GB, bucketSize=5.67 GB} 2014-08-20 20:23:00,218 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.61 MB, total=11.34 GB, single=568.25 MB, multi=10.80 GB, memory=81.20 KB 2014-08-20 20:23:10,243 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.01 MB of total=11.37 GB 2014-08-20 20:23:10,445 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.01 MB from BlockBucket{name=multi, totalSize=10.81 GB, bucketSize=5.67 GB} 2014-08-20 20:23:10,448 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.01 MB, total=11.34 GB, single=560.39 MB, multi=10.81 GB, memory=81.20 KB 2014-08-20 20:23:20,448 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.72 MB of total=11.37 GB 2014-08-20 20:23:20,654 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.72 MB from BlockBucket{name=multi, totalSize=10.82 GB, bucketSize=5.67 GB} 2014-08-20 20:23:20,657 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.73 MB, total=11.34 GB, single=551.92 MB, multi=10.82 GB, memory=81.20 KB 2014-08-20 20:23:30,657 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.87 MB of total=11.37 GB 2014-08-20 20:23:30,892 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.87 MB from BlockBucket{name=multi, totalSize=10.82 GB, bucketSize=5.67 GB} 2014-08-20 20:23:30,895 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.87 MB, total=11.34 GB, single=543.81 MB, multi=10.82 GB, memory=81.20 KB 2014-08-20 20:23:39,517 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:23:39,518 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:23:39,518 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:42883 because read count=-1. Number of active connections: 11 2014-08-20 20:23:39,518 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:23:39,518 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:23:40,904 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.87 MB of total=11.37 GB 2014-08-20 20:23:41,114 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.87 MB from BlockBucket{name=multi, totalSize=10.83 GB, bucketSize=5.67 GB} 2014-08-20 20:23:41,117 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.87 MB, total=11.34 GB, single=535.65 MB, multi=10.83 GB, memory=81.20 KB 2014-08-20 20:23:51,127 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.69 MB of total=11.37 GB 2014-08-20 20:23:51,360 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.69 MB from BlockBucket{name=multi, totalSize=10.84 GB, bucketSize=5.67 GB} 2014-08-20 20:23:51,363 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.70 MB, total=11.34 GB, single=527.38 MB, multi=10.84 GB, memory=81.20 KB 2014-08-20 20:24:01,365 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.17 MB of total=11.37 GB 2014-08-20 20:24:01,578 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.17 MB from BlockBucket{name=multi, totalSize=10.84 GB, bucketSize=5.67 GB} 2014-08-20 20:24:01,606 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.18 MB, total=11.34 GB, single=524.25 MB, multi=10.84 GB, memory=81.20 KB 2014-08-20 20:24:11,606 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.54 MB of total=11.37 GB 2014-08-20 20:24:11,852 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.54 MB from BlockBucket{name=multi, totalSize=10.85 GB, bucketSize=5.67 GB} 2014-08-20 20:24:11,856 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.54 MB, total=11.34 GB, single=519.48 MB, multi=10.85 GB, memory=81.20 KB 2014-08-20 20:24:21,856 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.89 MB of total=11.37 GB 2014-08-20 20:24:22,100 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.89 MB from BlockBucket{name=multi, totalSize=10.85 GB, bucketSize=5.67 GB} 2014-08-20 20:24:22,103 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.89 MB, total=11.34 GB, single=514.95 MB, multi=10.85 GB, memory=81.20 KB 2014-08-20 20:24:32,124 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.74 MB of total=11.37 GB 2014-08-20 20:24:32,334 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.74 MB from BlockBucket{name=multi, totalSize=10.86 GB, bucketSize=5.67 GB} 2014-08-20 20:24:32,336 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.74 MB, total=11.34 GB, single=507.46 MB, multi=10.86 GB, memory=81.20 KB 2014-08-20 20:24:42,336 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.87 MB of total=11.37 GB 2014-08-20 20:24:42,573 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.87 MB from BlockBucket{name=multi, totalSize=10.87 GB, bucketSize=5.67 GB} 2014-08-20 20:24:42,575 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.88 MB, total=11.34 GB, single=502.35 MB, multi=10.87 GB, memory=81.20 KB 2014-08-20 20:24:52,576 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.68 MB of total=11.37 GB 2014-08-20 20:24:52,779 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.68 MB from BlockBucket{name=multi, totalSize=10.87 GB, bucketSize=5.67 GB} 2014-08-20 20:24:52,810 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.69 MB, total=11.34 GB, single=497.76 MB, multi=10.87 GB, memory=81.20 KB 2014-08-20 20:25:02,810 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.55 MB of total=11.37 GB 2014-08-20 20:25:03,022 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.55 MB from BlockBucket{name=multi, totalSize=10.87 GB, bucketSize=5.67 GB} 2014-08-20 20:25:03,025 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=492.17 MB, multi=10.87 GB, memory=81.20 KB 2014-08-20 20:25:13,026 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.34 MB of total=11.37 GB 2014-08-20 20:25:13,311 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.34 MB from BlockBucket{name=multi, totalSize=10.88 GB, bucketSize=5.67 GB} 2014-08-20 20:25:13,314 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.35 MB, total=11.34 GB, single=490.26 MB, multi=10.88 GB, memory=81.20 KB 2014-08-20 20:25:23,316 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.74 MB of total=11.37 GB 2014-08-20 20:25:23,525 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.74 MB from BlockBucket{name=multi, totalSize=10.88 GB, bucketSize=5.67 GB} 2014-08-20 20:25:23,528 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.75 MB, total=11.34 GB, single=486.97 MB, multi=10.88 GB, memory=81.20 KB 2014-08-20 20:25:33,529 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.99 MB of total=11.37 GB 2014-08-20 20:25:33,760 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.99 MB from BlockBucket{name=multi, totalSize=10.88 GB, bucketSize=5.67 GB} 2014-08-20 20:25:33,763 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.00 MB, total=11.34 GB, single=482.52 MB, multi=10.88 GB, memory=81.20 KB 2014-08-20 20:25:43,763 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.77 MB of total=11.37 GB 2014-08-20 20:25:44,004 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.77 MB from BlockBucket{name=multi, totalSize=10.89 GB, bucketSize=5.67 GB} 2014-08-20 20:25:44,007 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.78 MB, total=11.34 GB, single=478.92 MB, multi=10.89 GB, memory=81.20 KB 2014-08-20 20:25:54,007 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.24 MB of total=11.37 GB 2014-08-20 20:25:54,253 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.24 MB from BlockBucket{name=multi, totalSize=10.89 GB, bucketSize=5.67 GB} 2014-08-20 20:25:54,256 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.24 MB, total=11.34 GB, single=476.93 MB, multi=10.89 GB, memory=81.20 KB 2014-08-20 20:26:04,278 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.47 MB of total=11.37 GB 2014-08-20 20:26:04,519 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.47 MB from BlockBucket{name=multi, totalSize=10.89 GB, bucketSize=5.67 GB} 2014-08-20 20:26:04,522 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.48 MB, total=11.34 GB, single=473.71 MB, multi=10.89 GB, memory=81.20 KB 2014-08-20 20:26:14,523 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.82 MB of total=11.37 GB 2014-08-20 20:26:14,761 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.82 MB from BlockBucket{name=multi, totalSize=10.90 GB, bucketSize=5.67 GB} 2014-08-20 20:26:14,764 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.82 MB, total=11.34 GB, single=470.31 MB, multi=10.90 GB, memory=81.20 KB 2014-08-20 20:26:24,764 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.28 MB of total=11.37 GB 2014-08-20 20:26:24,979 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.28 MB from BlockBucket{name=multi, totalSize=10.90 GB, bucketSize=5.67 GB} 2014-08-20 20:26:24,981 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.29 MB, total=11.34 GB, single=467.53 MB, multi=10.90 GB, memory=81.20 KB 2014-08-20 20:26:30,845 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=593.57 MB, max=11.94 GB, blockCount=722698, accesses=15058728, hits=14244025, hitRatio=94.59%, , cachingAccesses=15058716, cachingHits=14244013, cachingHitsRatio=94.59%, evictions=208, evicted=91970, evictedPerRun=442.1634521484375 2014-08-20 20:26:34,982 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.09 MB of total=11.37 GB 2014-08-20 20:26:35,224 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.09 MB from BlockBucket{name=multi, totalSize=10.90 GB, bucketSize=5.67 GB} 2014-08-20 20:26:35,227 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.11 MB, total=11.34 GB, single=465.28 MB, multi=10.90 GB, memory=81.20 KB 2014-08-20 20:26:38,525 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:26:38,525 DEBUG [htable-pool16-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:26:38,526 DEBUG [htable-pool16-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:26:38,526 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:43100; # active connections: 11 2014-08-20 20:26:38,527 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:26:38,531 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 64 2014-08-20 20:26:45,232 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.29 MB of total=11.37 GB 2014-08-20 20:26:45,444 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.29 MB from BlockBucket{name=multi, totalSize=10.90 GB, bucketSize=5.67 GB} 2014-08-20 20:26:45,447 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.31 MB, total=11.34 GB, single=463.92 MB, multi=10.90 GB, memory=81.20 KB 2014-08-20 20:26:55,470 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.16 MB of total=11.37 GB 2014-08-20 20:26:55,671 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.16 MB from BlockBucket{name=multi, totalSize=10.91 GB, bucketSize=5.67 GB} 2014-08-20 20:26:55,674 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.16 MB, total=11.34 GB, single=461.06 MB, multi=10.91 GB, memory=81.20 KB 2014-08-20 20:27:05,674 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.51 MB of total=11.37 GB 2014-08-20 20:27:05,908 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.51 MB from BlockBucket{name=multi, totalSize=10.91 GB, bucketSize=5.67 GB} 2014-08-20 20:27:05,911 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.51 MB, total=11.34 GB, single=459.13 MB, multi=10.91 GB, memory=81.20 KB 2014-08-20 20:27:15,911 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.06 MB of total=11.37 GB 2014-08-20 20:27:16,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.06 MB from BlockBucket{name=multi, totalSize=10.91 GB, bucketSize=5.67 GB} 2014-08-20 20:27:16,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.06 MB, total=11.34 GB, single=455.89 MB, multi=10.91 GB, memory=81.20 KB 2014-08-20 20:27:26,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.56 MB of total=11.37 GB 2014-08-20 20:27:26,433 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.56 MB from BlockBucket{name=multi, totalSize=10.91 GB, bucketSize=5.67 GB} 2014-08-20 20:27:26,436 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.57 MB, total=11.34 GB, single=455.17 MB, multi=10.91 GB, memory=81.20 KB 2014-08-20 20:27:36,436 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.94 MB of total=11.37 GB 2014-08-20 20:27:36,645 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.94 MB from BlockBucket{name=multi, totalSize=10.91 GB, bucketSize=5.67 GB} 2014-08-20 20:27:36,648 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.95 MB, total=11.34 GB, single=452.87 MB, multi=10.91 GB, memory=81.20 KB 2014-08-20 20:27:46,649 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.66 MB of total=11.37 GB 2014-08-20 20:27:46,880 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.66 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:27:46,882 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.67 MB, total=11.34 GB, single=450.39 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:27:56,883 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.81 MB of total=11.37 GB 2014-08-20 20:27:57,091 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.81 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:27:57,094 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=448.51 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:28:07,115 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.19 MB of total=11.37 GB 2014-08-20 20:28:07,361 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.19 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:28:07,364 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.19 MB, total=11.34 GB, single=448.30 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:28:17,364 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.07 MB of total=11.37 GB 2014-08-20 20:28:17,601 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.07 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:28:17,604 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.08 MB, total=11.34 GB, single=447.52 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:28:27,604 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.03 MB of total=11.37 GB 2014-08-20 20:28:27,842 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.03 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:28:27,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.05 MB, total=11.34 GB, single=447.28 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:28:37,858 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.20 MB of total=11.37 GB 2014-08-20 20:28:38,074 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.20 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:28:38,077 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.21 MB, total=11.34 GB, single=446.68 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:28:39,179 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:28:39,179 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:28:39,179 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:43100 because read count=-1. Number of active connections: 11 2014-08-20 20:28:39,179 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:28:39,179 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:28:48,101 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.28 MB of total=11.37 GB 2014-08-20 20:28:48,370 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.28 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:28:48,373 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.29 MB, total=11.34 GB, single=446.17 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:28:58,373 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.67 MB of total=11.37 GB 2014-08-20 20:28:58,664 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.67 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:28:58,668 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.68 MB, total=11.34 GB, single=445.06 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:29:08,669 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.31 MB of total=11.37 GB 2014-08-20 20:29:08,961 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.31 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:29:08,964 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.32 MB, total=11.34 GB, single=443.93 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:29:18,964 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.61 MB of total=11.37 GB 2014-08-20 20:29:19,225 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.61 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:29:19,228 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.62 MB, total=11.34 GB, single=444.12 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:29:29,229 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.42 MB of total=11.37 GB 2014-08-20 20:29:29,491 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.42 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:29:29,494 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.44 MB, total=11.34 GB, single=442.51 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:29:39,517 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.33 MB of total=11.37 GB 2014-08-20 20:29:39,785 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.33 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:29:39,788 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.35 MB, total=11.34 GB, single=441.90 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:29:49,789 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.46 MB of total=11.37 GB 2014-08-20 20:29:50,057 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.46 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:29:50,060 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.48 MB, total=11.34 GB, single=441.26 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:30:00,072 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.78 MB of total=11.37 GB 2014-08-20 20:30:00,375 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.78 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:30:00,378 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.79 MB, total=11.34 GB, single=441.76 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:30:10,381 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.24 MB of total=11.37 GB 2014-08-20 20:30:10,659 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.24 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:30:10,662 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.25 MB, total=11.34 GB, single=440.13 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:30:20,663 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.73 MB of total=11.37 GB 2014-08-20 20:30:20,922 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.73 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:30:20,925 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.73 MB, total=11.34 GB, single=437.86 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:30:30,926 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.46 MB of total=11.37 GB 2014-08-20 20:30:31,203 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.46 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:30:31,206 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.48 MB, total=11.34 GB, single=437.78 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:30:41,207 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.59 MB of total=11.37 GB 2014-08-20 20:30:41,512 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.59 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:30:41,515 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.60 MB, total=11.34 GB, single=436.39 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:30:51,515 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.04 MB of total=11.37 GB 2014-08-20 20:30:51,780 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.04 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:30:51,783 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.05 MB, total=11.34 GB, single=435.79 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:31:01,784 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.33 MB of total=11.37 GB 2014-08-20 20:31:02,082 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.33 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:31:02,085 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.35 MB, total=11.34 GB, single=433.68 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:31:12,086 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.68 MB of total=11.37 GB 2014-08-20 20:31:12,344 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.68 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:31:12,379 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.69 MB, total=11.34 GB, single=432.70 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:31:22,380 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.23 MB of total=11.37 GB 2014-08-20 20:31:22,671 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.23 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:31:22,674 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.24 MB, total=11.34 GB, single=431.35 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:31:30,824 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=587.71 MB, max=11.94 GB, blockCount=723063, accesses=19397322, hits=18530179, hitRatio=95.53%, , cachingAccesses=19397316, cachingHits=18530173, cachingHitsRatio=95.53%, evictions=237, evicted=144034, evictedPerRun=607.7384033203125 2014-08-20 20:31:32,693 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.63 MB of total=11.37 GB 2014-08-20 20:31:32,996 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.63 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:31:32,999 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.64 MB, total=11.34 GB, single=430.37 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:31:38,527 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:31:38,527 DEBUG [htable-pool17-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:31:38,527 DEBUG [htable-pool17-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:31:38,528 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:43316; # active connections: 11 2014-08-20 20:31:38,528 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:31:38,533 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 65 2014-08-20 20:31:42,999 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.33 MB of total=11.37 GB 2014-08-20 20:31:43,273 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.33 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:31:43,276 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.33 MB, total=11.34 GB, single=430.74 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:31:53,302 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.38 MB of total=11.37 GB 2014-08-20 20:31:53,569 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.38 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:31:53,598 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.39 MB, total=11.34 GB, single=431.84 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:32:03,616 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.68 MB of total=11.37 GB 2014-08-20 20:32:03,880 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.68 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:32:03,883 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.69 MB, total=11.34 GB, single=431.86 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:32:13,884 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.95 MB of total=11.37 GB 2014-08-20 20:32:14,151 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.95 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:32:14,154 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.96 MB, total=11.34 GB, single=431.78 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:32:24,155 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.66 MB of total=11.37 GB 2014-08-20 20:32:24,421 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.66 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:32:24,451 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.67 MB, total=11.34 GB, single=433.54 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:32:34,470 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.00 MB of total=11.37 GB 2014-08-20 20:32:34,738 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.00 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:32:34,742 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=433.44 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:32:44,742 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.50 MB of total=11.37 GB 2014-08-20 20:32:44,988 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.50 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:32:44,991 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.51 MB, total=11.34 GB, single=433.47 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:32:54,991 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.09 MB of total=11.37 GB 2014-08-20 20:32:55,241 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.09 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:32:55,244 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.10 MB, total=11.34 GB, single=433.17 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:33:05,244 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.81 MB of total=11.37 GB 2014-08-20 20:33:05,490 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.81 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:33:05,493 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=433.74 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:33:15,493 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.76 MB of total=11.37 GB 2014-08-20 20:33:15,742 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:33:15,770 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.76 MB, total=11.34 GB, single=434.41 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:33:25,770 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.80 MB of total=11.37 GB 2014-08-20 20:33:26,012 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.80 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:33:26,015 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=436.47 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:33:36,033 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.53 MB of total=11.37 GB 2014-08-20 20:33:36,251 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.53 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:33:36,254 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.54 MB, total=11.34 GB, single=436.42 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:33:39,240 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:33:39,240 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:33:39,241 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:43316 because read count=-1. Number of active connections: 11 2014-08-20 20:33:39,241 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:33:39,241 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:33:46,255 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.54 MB of total=11.37 GB 2014-08-20 20:33:46,497 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.54 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:33:46,499 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=435.92 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:33:56,500 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.58 MB of total=11.37 GB 2014-08-20 20:33:56,716 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.58 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:33:56,719 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.59 MB, total=11.34 GB, single=436.28 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:34:06,734 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.21 MB of total=11.37 GB 2014-08-20 20:34:06,951 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.21 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:34:06,954 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.23 MB, total=11.34 GB, single=438.31 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:34:16,954 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.80 MB of total=11.37 GB 2014-08-20 20:34:17,204 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.80 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:34:17,206 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=438.60 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:34:27,207 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.83 MB of total=11.37 GB 2014-08-20 20:34:27,463 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.83 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:34:27,465 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.84 MB, total=11.34 GB, single=437.90 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:34:37,466 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.47 MB of total=11.37 GB 2014-08-20 20:34:37,708 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.47 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:34:37,711 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.48 MB, total=11.34 GB, single=438.01 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:34:47,712 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.55 MB of total=11.37 GB 2014-08-20 20:34:47,931 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.55 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:34:47,934 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=438.16 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:34:57,961 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.51 MB of total=11.37 GB 2014-08-20 20:34:58,211 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.51 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:34:58,214 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.53 MB, total=11.34 GB, single=438.54 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:35:08,214 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.11 MB of total=11.37 GB 2014-08-20 20:35:08,430 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:35:08,432 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.13 MB, total=11.34 GB, single=437.42 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:35:18,438 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.54 MB of total=11.37 GB 2014-08-20 20:35:18,687 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.54 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:35:18,691 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.55 MB, total=11.34 GB, single=435.95 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:35:28,691 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.66 MB of total=11.37 GB 2014-08-20 20:35:28,935 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.66 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:35:28,938 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.67 MB, total=11.34 GB, single=436.40 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:35:38,939 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.78 MB of total=11.37 GB 2014-08-20 20:35:39,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.78 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:35:39,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.79 MB, total=11.34 GB, single=436.24 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:35:49,187 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.18 MB of total=11.37 GB 2014-08-20 20:35:49,407 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.18 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:35:49,410 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.19 MB, total=11.34 GB, single=436.00 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:35:59,410 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.56 MB of total=11.37 GB 2014-08-20 20:35:59,666 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.56 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:35:59,669 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.57 MB, total=11.34 GB, single=435.63 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:36:09,686 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.80 MB of total=11.37 GB 2014-08-20 20:36:09,941 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.80 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:36:09,944 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=435.60 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:36:19,944 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.35 MB of total=11.37 GB 2014-08-20 20:36:20,199 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.35 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:36:20,202 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.37 MB, total=11.34 GB, single=436.28 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:36:30,223 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.98 MB of total=11.37 GB 2014-08-20 20:36:30,478 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.98 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:36:30,481 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.00 MB, total=11.34 GB, single=434.67 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:36:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.34 GB, freeSize=609.52 MB, max=11.94 GB, blockCount=721697, accesses=23723559, hits=22803977, hitRatio=96.12%, , cachingAccesses=23723547, cachingHits=22803965, cachingHitsRatio=96.12%, evictions=267, evicted=197839, evictedPerRun=740.9700317382812 2014-08-20 20:36:38,527 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:36:38,528 DEBUG [htable-pool18-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:36:38,528 DEBUG [htable-pool18-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:36:38,528 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:43528; # active connections: 11 2014-08-20 20:36:38,528 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:36:38,534 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 66 2014-08-20 20:36:40,490 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.54 MB of total=11.37 GB 2014-08-20 20:36:40,716 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.54 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:36:40,719 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=433.23 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:36:49,906 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51935 because read count=-1. Number of active connections: 11 2014-08-20 20:36:49,906 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51939 because read count=-1. Number of active connections: 11 2014-08-20 20:36:49,907 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51943 because read count=-1. Number of active connections: 10 2014-08-20 20:36:49,906 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51944 because read count=-1. Number of active connections: 10 2014-08-20 20:36:49,906 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51941 because read count=-1. Number of active connections: 11 2014-08-20 20:36:50,005 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:36:50,005 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:36:50,006 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51936 because read count=-1. Number of active connections: 6 2014-08-20 20:36:50,005 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:36:50,006 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51946 because read count=-1. Number of active connections: 5 2014-08-20 20:36:50,005 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:36:50,006 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51938 because read count=-1. Number of active connections: 4 2014-08-20 20:36:50,005 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51945 because read count=-1. Number of active connections: 6 2014-08-20 20:36:50,005 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:36:50,006 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:51942 because read count=-1. Number of active connections: 2 2014-08-20 20:36:50,719 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 24.97 MB of total=11.36 GB 2014-08-20 20:36:50,843 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 24.97 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:36:50,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=24.97 MB, total=11.34 GB, single=433.60 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:37:00,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -568 B of total=11.34 GB 2014-08-20 20:37:10,846 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -568 B of total=11.34 GB 2014-08-20 20:37:20,846 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -568 B of total=11.34 GB 2014-08-20 20:37:30,847 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -568 B of total=11.34 GB 2014-08-20 20:37:40,847 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -568 B of total=11.34 GB 2014-08-20 20:37:50,848 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -568 B of total=11.34 GB 2014-08-20 20:37:52,522 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52335; # active connections: 2 2014-08-20 20:37:52,580 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52336; # active connections: 3 2014-08-20 20:37:52,649 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52335 because read count=-1. Number of active connections: 3 2014-08-20 20:37:52,649 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52336 because read count=-1. Number of active connections: 3 2014-08-20 20:37:52,979 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52348; # active connections: 2 2014-08-20 20:37:52,979 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52349; # active connections: 3 2014-08-20 20:37:52,988 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52350; # active connections: 4 2014-08-20 20:37:52,988 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52351; # active connections: 5 2014-08-20 20:37:52,990 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52352; # active connections: 6 2014-08-20 20:37:52,990 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52354; # active connections: 7 2014-08-20 20:37:52,990 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52353; # active connections: 8 2014-08-20 20:37:52,991 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52356; # active connections: 9 2014-08-20 20:37:52,991 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52355; # active connections: 10 2014-08-20 20:37:52,991 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52357; # active connections: 11 2014-08-20 20:38:00,849 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 21.55 MB of total=11.36 GB 2014-08-20 20:38:01,103 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 21.55 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:38:01,105 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=21.55 MB, total=11.34 GB, single=434.68 MB, multi=10.92 GB, memory=81.20 KB 2014-08-20 20:38:11,105 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.50 MB of total=11.37 GB 2014-08-20 20:38:11,370 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.50 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:38:11,373 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.50 MB, total=11.34 GB, single=433.90 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:38:21,373 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.87 MB of total=11.37 GB 2014-08-20 20:38:21,625 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.87 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:38:21,655 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.88 MB, total=11.34 GB, single=434.19 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:38:31,670 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.45 MB of total=11.37 GB 2014-08-20 20:38:31,923 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.45 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:38:31,926 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.45 MB, total=11.34 GB, single=434.45 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:38:38,888 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:38:38,888 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:38:38,888 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:43528 because read count=-1. Number of active connections: 11 2014-08-20 20:38:38,888 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:38:38,888 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:38:41,927 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.99 MB of total=11.37 GB 2014-08-20 20:38:42,218 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.99 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:38:42,222 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.01 MB, total=11.34 GB, single=434.58 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:38:52,239 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.36 MB of total=11.37 GB 2014-08-20 20:38:52,505 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.36 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:38:52,536 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.36 MB, total=11.34 GB, single=435.78 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:39:02,537 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.57 MB of total=11.37 GB 2014-08-20 20:39:02,837 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.57 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:39:02,840 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.57 MB, total=11.34 GB, single=436.70 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:39:12,860 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.91 MB of total=11.37 GB 2014-08-20 20:39:13,153 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.91 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:39:13,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.91 MB, total=11.34 GB, single=435.47 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:39:23,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.12 MB of total=11.37 GB 2014-08-20 20:39:23,419 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.12 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:39:23,422 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.13 MB, total=11.34 GB, single=434.18 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:39:33,423 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.66 MB of total=11.37 GB 2014-08-20 20:39:33,684 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.66 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:39:33,687 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.67 MB, total=11.34 GB, single=433.49 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:39:43,713 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.88 MB of total=11.37 GB 2014-08-20 20:39:43,984 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.88 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:39:43,988 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.90 MB, total=11.34 GB, single=434.39 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:39:53,988 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.65 MB of total=11.37 GB 2014-08-20 20:39:54,290 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.65 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:39:54,293 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.67 MB, total=11.34 GB, single=431.61 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:40:04,298 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.30 MB of total=11.37 GB 2014-08-20 20:40:04,591 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.30 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:40:04,594 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.31 MB, total=11.34 GB, single=433.66 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:40:14,610 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.32 MB of total=11.37 GB 2014-08-20 20:40:14,872 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.32 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:40:14,875 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.32 MB, total=11.34 GB, single=433.59 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:40:24,892 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.25 MB of total=11.37 GB 2014-08-20 20:40:25,182 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.25 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:40:25,185 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.26 MB, total=11.34 GB, single=433.63 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:40:35,193 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.98 MB of total=11.37 GB 2014-08-20 20:40:35,509 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.98 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:40:35,512 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.99 MB, total=11.34 GB, single=433.32 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:40:45,513 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.76 MB of total=11.37 GB 2014-08-20 20:40:45,807 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:40:45,810 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.77 MB, total=11.34 GB, single=433.16 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:40:55,811 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.71 MB of total=11.37 GB 2014-08-20 20:40:56,038 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:40:56,041 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.72 MB, total=11.34 GB, single=432.58 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:41:06,042 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.20 MB of total=11.37 GB 2014-08-20 20:41:06,334 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.20 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:41:06,337 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.21 MB, total=11.34 GB, single=431.71 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:41:16,338 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.26 MB of total=11.37 GB 2014-08-20 20:41:16,626 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.26 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:41:16,629 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.27 MB, total=11.34 GB, single=430.32 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:41:26,638 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.92 MB of total=11.37 GB 2014-08-20 20:41:26,926 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.92 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:41:26,929 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.93 MB, total=11.34 GB, single=431.39 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:41:30,840 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=598.78 MB, max=11.94 GB, blockCount=722370, accesses=27230941, hits=26268968, hitRatio=96.47%, , cachingAccesses=27230932, cachingHits=26268959, cachingHitsRatio=96.47%, evictions=296, evicted=239556, evictedPerRun=809.310791015625 2014-08-20 20:41:36,946 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.17 MB of total=11.37 GB 2014-08-20 20:41:37,201 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.17 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:41:37,203 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.18 MB, total=11.34 GB, single=431.21 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:41:38,527 DEBUG [htable-pool19-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:41:38,527 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:41:38,527 DEBUG [htable-pool19-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:41:38,528 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:43752; # active connections: 11 2014-08-20 20:41:38,528 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:41:38,533 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 119 2014-08-20 20:41:47,204 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.49 MB of total=11.37 GB 2014-08-20 20:41:47,424 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.49 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:41:47,427 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.50 MB, total=11.34 GB, single=430.64 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:41:57,427 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.84 MB of total=11.37 GB 2014-08-20 20:41:57,705 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.84 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:41:57,708 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.85 MB, total=11.34 GB, single=431.88 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:42:07,708 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.72 MB of total=11.37 GB 2014-08-20 20:42:07,995 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.72 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:42:08,025 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.73 MB, total=11.34 GB, single=432.76 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:42:18,025 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.35 MB of total=11.37 GB 2014-08-20 20:42:18,307 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.35 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:42:18,310 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.35 MB, total=11.34 GB, single=431.85 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:42:28,310 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.82 MB of total=11.37 GB 2014-08-20 20:42:28,563 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.82 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:42:28,566 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.82 MB, total=11.34 GB, single=431.00 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:42:38,566 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.19 MB of total=11.37 GB 2014-08-20 20:42:38,857 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.19 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:42:38,861 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.20 MB, total=11.34 GB, single=432.22 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:42:48,861 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.76 MB of total=11.37 GB 2014-08-20 20:42:49,190 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:42:49,193 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.76 MB, total=11.34 GB, single=432.01 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:42:59,193 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.03 MB of total=11.37 GB 2014-08-20 20:42:59,493 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.03 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:42:59,496 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.04 MB, total=11.34 GB, single=432.71 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:43:09,519 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.20 MB of total=11.37 GB 2014-08-20 20:43:09,813 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.20 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:43:09,817 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.22 MB, total=11.34 GB, single=433.22 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:43:19,817 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.55 MB of total=11.37 GB 2014-08-20 20:43:20,088 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.55 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:43:20,119 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.56 MB, total=11.34 GB, single=433.51 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:43:30,120 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.97 MB of total=11.37 GB 2014-08-20 20:43:30,420 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.97 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:43:30,423 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.98 MB, total=11.34 GB, single=433.53 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:43:39,137 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:43:39,138 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:43:39,138 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:43752 because read count=-1. Number of active connections: 11 2014-08-20 20:43:39,138 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:43:39,139 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:43:40,429 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.13 MB of total=11.37 GB 2014-08-20 20:43:40,727 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.13 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:43:40,730 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.14 MB, total=11.34 GB, single=434.92 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:43:50,731 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.01 MB of total=11.37 GB 2014-08-20 20:43:51,042 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.01 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:43:51,045 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.03 MB, total=11.34 GB, single=434.31 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:44:01,094 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.06 MB of total=11.37 GB 2014-08-20 20:44:01,368 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.06 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:44:01,398 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.07 MB, total=11.34 GB, single=434.91 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:44:11,407 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.30 MB of total=11.37 GB 2014-08-20 20:44:11,682 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.30 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:44:11,713 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.31 MB, total=11.34 GB, single=435.55 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:44:21,714 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.55 MB of total=11.37 GB 2014-08-20 20:44:21,950 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.55 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:44:21,978 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.57 MB, total=11.34 GB, single=435.89 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:44:31,979 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.21 MB of total=11.37 GB 2014-08-20 20:44:32,282 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.21 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:44:32,285 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.23 MB, total=11.34 GB, single=435.60 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:44:42,285 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.21 MB of total=11.37 GB 2014-08-20 20:44:42,607 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.21 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:44:42,610 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.23 MB, total=11.34 GB, single=435.28 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:44:52,619 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.47 MB of total=11.37 GB 2014-08-20 20:44:52,932 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.47 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:44:52,936 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.48 MB, total=11.34 GB, single=436.94 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:45:02,937 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.14 MB of total=11.37 GB 2014-08-20 20:45:03,242 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.14 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:45:03,245 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.15 MB, total=11.34 GB, single=436.49 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:45:13,246 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.14 MB of total=11.37 GB 2014-08-20 20:45:13,553 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.14 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:45:13,556 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.14 MB, total=11.34 GB, single=435.57 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:45:23,582 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.35 MB of total=11.37 GB 2014-08-20 20:45:23,851 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.35 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:45:23,854 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.35 MB, total=11.34 GB, single=436.01 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:45:33,855 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.09 MB of total=11.37 GB 2014-08-20 20:45:34,163 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.09 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:45:34,194 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.09 MB, total=11.34 GB, single=435.42 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:45:44,203 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.04 MB of total=11.37 GB 2014-08-20 20:45:44,511 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.04 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:45:44,514 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.04 MB, total=11.34 GB, single=436.81 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:45:54,515 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.29 MB of total=11.37 GB 2014-08-20 20:45:54,824 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.29 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:45:54,827 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.31 MB, total=11.34 GB, single=436.56 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:46:04,841 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.34 MB of total=11.37 GB 2014-08-20 20:46:05,153 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.34 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:46:05,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.34 MB, total=11.34 GB, single=436.14 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:46:15,157 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.78 MB of total=11.37 GB 2014-08-20 20:46:15,469 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.78 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:46:15,473 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.79 MB, total=11.34 GB, single=435.79 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:46:25,500 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.34 MB of total=11.37 GB 2014-08-20 20:46:25,816 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.34 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:46:25,819 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.34 MB, total=11.34 GB, single=435.17 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:46:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=596.17 MB, max=11.94 GB, blockCount=722533, accesses=31705469, hits=30689212, hitRatio=96.79%, , cachingAccesses=31705457, cachingHits=30689200, cachingHitsRatio=96.79%, evictions=325, evicted=293670, evictedPerRun=903.5999755859375 2014-08-20 20:46:35,839 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.69 MB of total=11.37 GB 2014-08-20 20:46:36,142 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.69 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:46:36,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.70 MB, total=11.34 GB, single=432.51 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:46:38,543 DEBUG [htable-pool20-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:46:38,543 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:46:38,543 DEBUG [htable-pool20-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:46:38,543 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:43965; # active connections: 11 2014-08-20 20:46:38,544 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:46:38,550 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 120 2014-08-20 20:46:46,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.11 MB of total=11.37 GB 2014-08-20 20:46:46,491 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:46:46,495 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.12 MB, total=11.34 GB, single=434.78 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:46:56,507 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.72 MB of total=11.37 GB 2014-08-20 20:46:56,780 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.72 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:46:56,782 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.73 MB, total=11.34 GB, single=433.26 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:47:06,783 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.41 MB of total=11.37 GB 2014-08-20 20:47:07,116 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.41 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:47:07,119 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.42 MB, total=11.34 GB, single=433.44 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:47:17,119 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.01 MB of total=11.37 GB 2014-08-20 20:47:17,423 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.01 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:47:17,454 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.02 MB, total=11.34 GB, single=432.23 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:47:27,472 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.51 MB of total=11.37 GB 2014-08-20 20:47:27,779 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.51 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:47:27,783 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.51 MB, total=11.34 GB, single=432.40 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:47:37,783 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.56 MB of total=11.37 GB 2014-08-20 20:47:38,042 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.56 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:47:38,072 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.57 MB, total=11.34 GB, single=433.02 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:47:48,073 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.52 MB of total=11.37 GB 2014-08-20 20:47:48,340 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.52 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:47:48,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.53 MB, total=11.34 GB, single=433.55 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:47:58,346 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.87 MB of total=11.37 GB 2014-08-20 20:47:58,648 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.87 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:47:58,651 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.88 MB, total=11.34 GB, single=434.51 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:48:08,651 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.08 MB of total=11.37 GB 2014-08-20 20:48:08,918 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.08 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:48:08,948 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.09 MB, total=11.34 GB, single=434.04 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:48:18,948 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.86 MB of total=11.37 GB 2014-08-20 20:48:19,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.86 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:48:19,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.87 MB, total=11.34 GB, single=434.30 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:48:29,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.98 MB of total=11.37 GB 2014-08-20 20:48:29,490 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.98 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:48:29,493 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.99 MB, total=11.34 GB, single=434.61 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:48:39,075 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:48:39,076 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:48:39,076 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:43965 because read count=-1. Number of active connections: 11 2014-08-20 20:48:39,076 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:48:39,076 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:48:39,494 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.27 MB of total=11.37 GB 2014-08-20 20:48:39,790 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.27 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:48:39,793 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.28 MB, total=11.34 GB, single=435.20 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:48:49,793 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.71 MB of total=11.37 GB 2014-08-20 20:48:50,091 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:48:50,094 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.72 MB, total=11.34 GB, single=434.83 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:49:00,121 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.25 MB of total=11.37 GB 2014-08-20 20:49:00,394 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.25 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:49:00,424 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.27 MB, total=11.34 GB, single=435.99 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:49:10,426 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.22 MB of total=11.37 GB 2014-08-20 20:49:10,725 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.22 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:49:10,729 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.23 MB, total=11.34 GB, single=435.05 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:49:20,729 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.95 MB of total=11.37 GB 2014-08-20 20:49:21,037 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.95 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:49:21,043 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.96 MB, total=11.34 GB, single=434.41 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:49:31,068 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.63 MB of total=11.37 GB 2014-08-20 20:49:31,339 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.63 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:49:31,342 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.64 MB, total=11.34 GB, single=434.01 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:49:41,347 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.78 MB of total=11.37 GB 2014-08-20 20:49:41,606 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.78 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:49:41,609 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.78 MB, total=11.34 GB, single=434.52 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:49:51,610 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.64 MB of total=11.37 GB 2014-08-20 20:49:51,873 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.64 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:49:51,876 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.64 MB, total=11.34 GB, single=436.37 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:50:01,876 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.39 MB of total=11.37 GB 2014-08-20 20:50:02,138 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.39 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:50:02,141 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.40 MB, total=11.34 GB, single=433.41 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:50:12,160 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.31 MB of total=11.37 GB 2014-08-20 20:50:12,469 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.31 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:50:12,473 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.31 MB, total=11.34 GB, single=434.06 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:50:22,473 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 20:50:22,775 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:50:22,778 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.12 MB, total=11.34 GB, single=433.28 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:50:32,778 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.80 MB of total=11.37 GB 2014-08-20 20:50:33,078 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.80 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:50:33,081 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.80 MB, total=11.34 GB, single=432.19 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:50:43,103 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.71 MB of total=11.37 GB 2014-08-20 20:50:43,363 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:50:43,367 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.72 MB, total=11.34 GB, single=433.53 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:50:53,368 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.72 MB of total=11.37 GB 2014-08-20 20:50:53,624 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.72 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:50:53,627 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.73 MB, total=11.34 GB, single=434.27 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:51:03,649 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.75 MB of total=11.37 GB 2014-08-20 20:51:03,910 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.75 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:51:03,913 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.75 MB, total=11.34 GB, single=434.76 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:51:13,916 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.46 MB of total=11.37 GB 2014-08-20 20:51:14,180 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.46 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:51:14,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.47 MB, total=11.34 GB, single=434.77 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:51:24,189 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 20:51:24,502 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:51:24,505 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.11 MB, total=11.34 GB, single=435.48 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:51:30,819 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=591.96 MB, max=11.94 GB, blockCount=722797, accesses=36179683, hits=35109379, hitRatio=97.04%, , cachingAccesses=36179671, cachingHits=35109367, cachingHitsRatio=97.04%, evictions=354, evicted=347444, evictedPerRun=981.480224609375 2014-08-20 20:51:34,505 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.49 MB of total=11.37 GB 2014-08-20 20:51:34,740 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] regionserver.LogRoller: Hlog roll period 3600000ms elapsed 2014-08-20 20:51:34,820 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.49 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:51:34,823 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.50 MB, total=11.34 GB, single=434.97 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:51:34,890 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] wal.FSHLog: Slow sync cost: 102 ms, current pipeline: [206.190.52.55:50010] 2014-08-20 20:51:35,158 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] wal.FSHLog: Rolled WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564293059 with entries=11, filesize=3.00 KB; new WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567894740 2014-08-20 20:51:35,158 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] wal.FSHLog: WAL file ready for archiving hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564293059 2014-08-20 20:51:38,543 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:51:38,543 DEBUG [htable-pool21-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:51:38,544 DEBUG [htable-pool21-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:51:38,544 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:44187; # active connections: 11 2014-08-20 20:51:38,545 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:51:38,550 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 121 2014-08-20 20:51:39,250 DEBUG [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] regionserver.LogRoller: Hlog roll period 3600000ms elapsed 2014-08-20 20:51:39,453 INFO [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] wal.FSHLog: Rolled WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564297828.meta with entries=24, filesize=10.04 KB; new WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567899250.meta 2014-08-20 20:51:44,826 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.92 MB of total=11.37 GB 2014-08-20 20:51:44,908 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.periodicFlusher] regionserver.HRegionServer: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.periodicFlusher requesting flush for region hbase:meta,,1.1588230740 after a delay of 7394 2014-08-20 20:51:45,169 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.92 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:51:45,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.93 MB, total=11.34 GB, single=433.51 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:51:52,430 INFO [MemStoreFlusher.1] regionserver.HRegion: Started memstore flush for hbase:meta,,1.1588230740, current region memstore size 16.91 KB 2014-08-20 20:51:52,814 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=75556, memsize=16.9 K, hasBloomFilter=false, into tmp file hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/.tmp/bdfc8a194a3b41fa8ad21487cd128f66 2014-08-20 20:51:52,852 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing store file hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/.tmp/bdfc8a194a3b41fa8ad21487cd128f66 as hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/bdfc8a194a3b41fa8ad21487cd128f66 2014-08-20 20:51:52,872 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/data/hbase/meta/1588230740/info/bdfc8a194a3b41fa8ad21487cd128f66, entries=66, sequenceid=75556, filesize=13.6 K 2014-08-20 20:51:52,898 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~16.91 KB/17320, currentsize=0 B/0 for region hbase:meta,,1.1588230740 in 468ms, sequenceid=75556, compaction requested=false 2014-08-20 20:51:55,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.94 MB of total=11.37 GB 2014-08-20 20:51:55,473 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.94 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:51:55,477 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.95 MB, total=11.34 GB, single=433.89 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:52:05,477 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.40 MB of total=11.37 GB 2014-08-20 20:52:05,754 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.40 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:52:05,758 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.41 MB, total=11.34 GB, single=434.03 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:52:15,758 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.85 MB of total=11.37 GB 2014-08-20 20:52:16,027 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.85 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:52:16,030 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.86 MB, total=11.34 GB, single=432.28 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:52:26,056 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.92 MB of total=11.37 GB 2014-08-20 20:52:26,317 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.92 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:52:26,320 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.93 MB, total=11.34 GB, single=432.80 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:52:36,320 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.46 MB of total=11.37 GB 2014-08-20 20:52:36,611 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.46 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:52:36,615 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.47 MB, total=11.34 GB, single=432.45 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:52:46,621 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.52 MB of total=11.37 GB 2014-08-20 20:52:46,857 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.52 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:52:46,860 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.53 MB, total=11.34 GB, single=432.51 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:52:56,861 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.04 MB of total=11.37 GB 2014-08-20 20:52:57,128 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.04 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:52:57,131 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.05 MB, total=11.34 GB, single=431.92 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:53:07,132 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.12 MB of total=11.37 GB 2014-08-20 20:53:07,471 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.12 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:53:07,475 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.13 MB, total=11.34 GB, single=431.40 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:53:17,487 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.32 MB of total=11.37 GB 2014-08-20 20:53:17,793 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.32 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:53:17,796 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.33 MB, total=11.34 GB, single=431.06 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:53:27,797 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.89 MB of total=11.37 GB 2014-08-20 20:53:28,141 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.89 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:53:28,145 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.89 MB, total=11.34 GB, single=429.32 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:53:38,145 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.81 MB of total=11.37 GB 2014-08-20 20:53:38,451 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.81 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:53:38,454 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.82 MB, total=11.34 GB, single=429.11 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:53:39,127 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:53:39,128 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:53:39,128 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:44187 because read count=-1. Number of active connections: 11 2014-08-20 20:53:39,128 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:53:39,128 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:53:48,454 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.13 MB of total=11.37 GB 2014-08-20 20:53:48,763 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.13 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:53:48,791 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.14 MB, total=11.34 GB, single=430.93 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:53:58,809 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.64 MB of total=11.37 GB 2014-08-20 20:53:59,116 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.64 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:53:59,120 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.64 MB, total=11.34 GB, single=431.25 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:54:09,120 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.10 MB of total=11.37 GB 2014-08-20 20:54:09,428 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.10 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:54:09,432 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.11 MB, total=11.34 GB, single=431.56 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:54:19,432 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.67 MB of total=11.37 GB 2014-08-20 20:54:19,774 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.67 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:54:19,778 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.67 MB, total=11.34 GB, single=431.11 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:54:29,778 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.10 MB of total=11.37 GB 2014-08-20 20:54:30,114 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.10 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:54:30,118 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.10 MB, total=11.34 GB, single=430.28 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:54:40,118 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.21 MB of total=11.37 GB 2014-08-20 20:54:40,449 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.21 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:54:40,453 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.21 MB, total=11.34 GB, single=429.99 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:54:50,453 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.87 MB of total=11.37 GB 2014-08-20 20:54:50,788 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.87 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:54:50,791 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.88 MB, total=11.34 GB, single=430.95 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:55:00,792 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.04 MB of total=11.37 GB 2014-08-20 20:55:01,126 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.04 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:55:01,129 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.04 MB, total=11.34 GB, single=432.00 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:55:11,141 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.04 MB of total=11.37 GB 2014-08-20 20:55:11,418 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.04 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:55:11,421 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.04 MB, total=11.34 GB, single=433.96 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:55:21,422 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.94 MB of total=11.37 GB 2014-08-20 20:55:21,733 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.94 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:55:21,737 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.94 MB, total=11.34 GB, single=433.02 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:55:31,737 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.13 MB of total=11.37 GB 2014-08-20 20:55:32,045 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.13 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:55:32,049 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.13 MB, total=11.34 GB, single=432.10 MB, multi=10.93 GB, memory=81.20 KB 2014-08-20 20:55:42,074 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.27 MB of total=11.37 GB 2014-08-20 20:55:42,353 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.27 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:55:42,384 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.27 MB, total=11.34 GB, single=431.60 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:55:52,384 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.67 MB of total=11.37 GB 2014-08-20 20:55:52,720 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.67 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:55:52,723 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.67 MB, total=11.34 GB, single=431.05 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:56:02,723 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.47 MB of total=11.37 GB 2014-08-20 20:56:03,037 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.47 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:56:03,040 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.48 MB, total=11.34 GB, single=430.97 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:56:13,041 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.33 MB of total=11.37 GB 2014-08-20 20:56:13,321 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.33 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:56:13,324 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.34 MB, total=11.34 GB, single=430.99 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:56:23,336 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.39 MB of total=11.37 GB 2014-08-20 20:56:23,645 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.39 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:56:23,649 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.40 MB, total=11.34 GB, single=431.18 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:56:30,840 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=588.48 MB, max=11.94 GB, blockCount=723015, accesses=40652360, hits=39528216, hitRatio=97.23%, , cachingAccesses=40652357, cachingHits=39528213, cachingHitsRatio=97.23%, evictions=383, evicted=401061, evictedPerRun=1047.1566162109375 2014-08-20 20:56:33,649 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.27 MB of total=11.37 GB 2014-08-20 20:56:33,993 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.27 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:56:33,996 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.28 MB, total=11.34 GB, single=432.20 MB, multi=10.94 GB, memory=81.20 KB 2014-08-20 20:56:38,543 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 20:56:38,544 DEBUG [htable-pool22-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 20:56:38,544 DEBUG [htable-pool22-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:56:38,545 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:44403; # active connections: 11 2014-08-20 20:56:38,545 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 20:56:38,600 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 122 2014-08-20 20:56:43,997 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.89 MB of total=11.37 GB 2014-08-20 20:56:44,329 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.89 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:56:44,332 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.91 MB, total=11.34 GB, single=431.70 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 20:56:54,333 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.82 MB of total=11.37 GB 2014-08-20 20:56:54,633 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.82 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 20:56:54,636 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.83 MB, total=11.34 GB, single=431.86 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 20:57:04,649 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.07 MB of total=11.37 GB 2014-08-20 20:57:04,913 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.07 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:57:04,916 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.08 MB, total=11.34 GB, single=432.03 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 20:57:14,926 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.09 MB of total=11.37 GB 2014-08-20 20:57:15,196 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.09 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:57:15,199 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.10 MB, total=11.34 GB, single=432.81 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 20:57:25,199 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.21 MB of total=11.37 GB 2014-08-20 20:57:25,495 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.21 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:57:25,527 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.22 MB, total=11.34 GB, single=433.69 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 20:57:35,527 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.21 MB of total=11.37 GB 2014-08-20 20:57:35,865 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.21 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:57:35,869 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.23 MB, total=11.34 GB, single=433.35 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 20:57:45,870 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.03 MB of total=11.37 GB 2014-08-20 20:57:46,164 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.03 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 20:57:46,168 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.04 MB, total=11.34 GB, single=434.17 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52352 because read count=-1. Number of active connections: 11 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52348 because read count=-1. Number of active connections: 11 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52350 because read count=-1. Number of active connections: 11 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52354 because read count=-1. Number of active connections: 8 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52355 because read count=-1. Number of active connections: 7 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52353 because read count=-1. Number of active connections: 6 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,268 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52356 because read count=-1. Number of active connections: 5 2014-08-20 20:57:50,266 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 20:57:50,268 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52357 because read count=-1. Number of active connections: 4 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52349 because read count=-1. Number of active connections: 7 2014-08-20 20:57:50,267 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52351 because read count=-1. Number of active connections: 8 2014-08-20 20:57:56,168 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 11.74 MB of total=11.35 GB 2014-08-20 20:57:56,298 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 11.74 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 20:57:56,299 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=11.75 MB, total=11.34 GB, single=433.94 MB, multi=10.92 GB, memory=91.23 KB 2014-08-20 20:58:06,300 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:58:16,300 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:58:26,301 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:58:36,302 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:58:39,108 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 20:58:39,108 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 20:58:39,108 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:44403 because read count=-1. Number of active connections: 1 2014-08-20 20:58:39,108 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 20:58:39,108 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 20:58:46,302 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:58:56,303 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:59:06,303 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:59:16,304 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:59:26,304 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:59:36,305 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:59:46,306 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 20:59:56,306 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:00:06,307 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:00:16,307 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:00:26,308 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:00:36,308 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:00:46,309 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:00:56,310 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:01:06,310 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:01:16,311 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:01:26,311 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:01:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.34 GB, freeSize=611.17 MB, max=11.94 GB, blockCount=721595, accesses=41830195, hits=40691847, hitRatio=97.28%, , cachingAccesses=41830183, cachingHits=40691835, cachingHitsRatio=97.28%, evictions=413, evicted=416688, evictedPerRun=1008.9298095703125 2014-08-20 21:01:36,312 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:01:38,543 DEBUG [htable-pool23-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:01:38,543 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:01:38,544 DEBUG [htable-pool23-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:01:38,544 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:44610; # active connections: 1 2014-08-20 21:01:38,544 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:01:38,550 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 123 2014-08-20 21:01:46,312 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:01:56,313 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:02:06,314 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:02:16,314 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:02:26,315 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:02:33,111 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] master.ReplicationLogCleaner: Didn't find this log in ZK, deleting: hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564293059 2014-08-20 21:02:36,315 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:02:46,316 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:02:56,316 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:03:06,317 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:03:16,317 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:03:26,318 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:03:36,319 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:03:38,576 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:03:38,576 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:03:38,576 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:03:38,576 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:03:38,576 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:44610 because read count=-1. Number of active connections: 1 2014-08-20 21:03:46,319 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:03:56,320 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:04:06,320 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:04:16,321 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:04:26,321 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:04:36,322 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:04:46,322 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:04:56,323 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:05:06,323 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:05:16,324 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:05:26,324 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:05:36,325 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:05:46,326 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:05:56,326 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:06:06,327 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:06:16,327 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:06:26,328 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:06:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.34 GB, freeSize=611.17 MB, max=11.94 GB, blockCount=721595, accesses=41830207, hits=40691859, hitRatio=97.28%, , cachingAccesses=41830195, cachingHits=40691847, cachingHitsRatio=97.28%, evictions=443, evicted=416688, evictedPerRun=940.60498046875 2014-08-20 21:06:36,328 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:06:38,544 DEBUG [htable-pool24-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:06:38,544 DEBUG [htable-pool24-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:06:38,544 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:06:38,545 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:44808; # active connections: 1 2014-08-20 21:06:38,546 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:06:38,551 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 124 2014-08-20 21:06:46,329 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:06:56,330 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:07:06,330 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:07:16,331 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:07:26,331 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:07:36,332 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:07:46,332 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:07:56,333 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:08:06,333 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:08:16,334 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:08:26,335 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:08:36,335 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:08:36,697 DEBUG [118844795@qtp-1578813876-75] ipc.RpcClient: Use SIMPLE authentication for service MasterService, sasl=false 2014-08-20 21:08:36,697 DEBUG [118844795@qtp-1578813876-75] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:08:36,698 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:44881; # active connections: 2 2014-08-20 21:08:36,698 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 2 2014-08-20 21:08:36,975 WARN [118844795@qtp-1578813876-75] util.HeapMemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2014-08-20 21:08:38,575 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:08:38,575 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:08:38,575 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:08:38,575 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:44808 because read count=-1. Number of active connections: 2 2014-08-20 21:08:38,575 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 1 2014-08-20 21:08:46,336 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:08:56,336 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:09:06,337 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:09:16,337 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:09:26,338 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:09:36,338 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:09:46,339 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:09:56,340 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:10:06,340 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:10:16,341 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:10:26,341 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:10:36,342 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:10:36,832 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:10:36,833 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:10:36,833 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:10:36,833 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:10:36,833 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:44881 because read count=-1. Number of active connections: 1 2014-08-20 21:10:46,342 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:10:56,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:11:06,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:11:16,344 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:11:26,345 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:11:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.34 GB, freeSize=611.17 MB, max=11.94 GB, blockCount=721595, accesses=41830219, hits=40691871, hitRatio=97.28%, , cachingAccesses=41830207, cachingHits=40691859, cachingHitsRatio=97.28%, evictions=473, evicted=416688, evictedPerRun=880.9471435546875 2014-08-20 21:11:36,345 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:11:38,544 DEBUG [htable-pool25-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:11:38,544 DEBUG [htable-pool25-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:11:38,545 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:44993; # active connections: 1 2014-08-20 21:11:38,545 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:11:38,545 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:11:38,552 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 125 2014-08-20 21:11:46,346 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:11:56,346 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:12:06,347 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:12:16,347 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:12:26,348 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:12:36,348 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:12:46,349 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:12:56,350 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:13:06,350 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:13:16,351 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:13:26,351 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:13:36,352 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:13:38,575 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:13:38,576 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:13:38,576 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:44993 because read count=-1. Number of active connections: 1 2014-08-20 21:13:38,576 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:13:38,576 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:13:46,352 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:13:56,353 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:14:06,353 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:14:16,354 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:14:26,354 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:14:36,355 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -12.51 KB of total=11.34 GB 2014-08-20 21:14:41,723 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52963; # active connections: 1 2014-08-20 21:14:41,780 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52964; # active connections: 2 2014-08-20 21:14:41,835 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52963 because read count=-1. Number of active connections: 2 2014-08-20 21:14:41,835 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52964 because read count=-1. Number of active connections: 1 2014-08-20 21:14:42,114 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52976; # active connections: 1 2014-08-20 21:14:42,114 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52978; # active connections: 2 2014-08-20 21:14:42,115 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52977; # active connections: 3 2014-08-20 21:14:42,115 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52982; # active connections: 4 2014-08-20 21:14:42,122 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52983; # active connections: 5 2014-08-20 21:14:42,122 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52984; # active connections: 6 2014-08-20 21:14:42,124 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52986; # active connections: 7 2014-08-20 21:14:42,124 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52985; # active connections: 8 2014-08-20 21:14:42,125 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52988; # active connections: 9 2014-08-20 21:14:42,125 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:52987; # active connections: 10 2014-08-20 21:14:46,364 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 10.71 MB of total=11.35 GB 2014-08-20 21:14:46,579 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 10.71 MB from BlockBucket{name=multi, totalSize=10.91 GB, bucketSize=5.67 GB} 2014-08-20 21:14:46,580 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=10.73 MB, total=11.34 GB, single=434.60 MB, multi=10.91 GB, memory=91.23 KB 2014-08-20 21:14:56,581 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.34 MB of total=11.37 GB 2014-08-20 21:14:56,886 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.34 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:14:56,889 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.36 MB, total=11.34 GB, single=435.55 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:15:06,896 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.30 MB of total=11.37 GB 2014-08-20 21:15:07,193 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.30 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:15:07,196 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.30 MB, total=11.34 GB, single=435.49 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:15:17,225 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.45 MB of total=11.37 GB 2014-08-20 21:15:17,498 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.45 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:15:17,528 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.45 MB, total=11.34 GB, single=437.19 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:15:27,528 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.43 MB of total=11.37 GB 2014-08-20 21:15:27,795 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.43 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:15:27,798 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.45 MB, total=11.34 GB, single=437.93 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:15:37,799 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.49 MB of total=11.37 GB 2014-08-20 21:15:38,098 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.49 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:15:38,101 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.51 MB, total=11.34 GB, single=437.07 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:15:48,102 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.67 MB of total=11.37 GB 2014-08-20 21:15:48,404 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.67 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:15:48,407 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.67 MB, total=11.34 GB, single=435.66 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:15:58,408 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.37 MB of total=11.37 GB 2014-08-20 21:15:58,709 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.37 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:15:58,712 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.37 MB, total=11.34 GB, single=436.59 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:16:08,734 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.70 MB of total=11.37 GB 2014-08-20 21:16:09,041 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.70 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:16:09,044 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.71 MB, total=11.34 GB, single=437.34 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:16:19,045 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.29 MB of total=11.37 GB 2014-08-20 21:16:19,353 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.29 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:16:19,357 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.29 MB, total=11.34 GB, single=437.28 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:16:29,370 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.09 MB of total=11.37 GB 2014-08-20 21:16:29,655 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.09 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:16:29,686 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.09 MB, total=11.34 GB, single=440.23 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:16:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.34 GB, freeSize=606.70 MB, max=11.94 GB, blockCount=721875, accesses=43400156, hits=42242548, hitRatio=97.33%, , cachingAccesses=43400144, cachingHits=42242536, cachingHitsRatio=97.33%, evictions=503, evicted=435665, evictedPerRun=866.1331787109375 2014-08-20 21:16:38,554 DEBUG [htable-pool26-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:16:38,554 DEBUG [htable-pool26-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:16:38,554 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:16:38,556 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:16:38,558 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:45176; # active connections: 11 2014-08-20 21:16:38,563 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 178 2014-08-20 21:16:39,708 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.92 MB of total=11.37 GB 2014-08-20 21:16:40,023 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.92 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:16:40,027 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.94 MB, total=11.34 GB, single=437.97 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:16:50,027 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.42 MB of total=11.37 GB 2014-08-20 21:16:50,339 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.42 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:16:50,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.42 MB, total=11.34 GB, single=436.93 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:17:00,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.67 MB of total=11.37 GB 2014-08-20 21:17:00,651 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.67 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:17:00,681 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.67 MB, total=11.34 GB, single=436.63 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:17:10,682 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.00 MB of total=11.37 GB 2014-08-20 21:17:10,986 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.00 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:17:10,990 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=435.27 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:17:21,003 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.71 MB of total=11.37 GB 2014-08-20 21:17:21,271 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:17:21,274 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.72 MB, total=11.34 GB, single=434.74 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:17:31,274 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.29 MB of total=11.37 GB 2014-08-20 21:17:31,547 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.29 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:17:31,550 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.29 MB, total=11.34 GB, single=435.29 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:17:41,567 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.47 MB of total=11.37 GB 2014-08-20 21:17:41,880 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.47 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:17:41,884 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.47 MB, total=11.34 GB, single=435.51 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:17:51,904 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.79 MB of total=11.37 GB 2014-08-20 21:17:52,221 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.79 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:17:52,225 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.80 MB, total=11.34 GB, single=435.02 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:18:02,232 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.44 MB of total=11.37 GB 2014-08-20 21:18:02,537 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.44 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:18:02,541 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.45 MB, total=11.34 GB, single=431.92 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:18:12,541 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.27 MB of total=11.37 GB 2014-08-20 21:18:12,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.27 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:18:12,848 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.27 MB, total=11.34 GB, single=432.02 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:18:22,848 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.58 MB of total=11.37 GB 2014-08-20 21:18:23,179 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.58 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:18:23,182 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.58 MB, total=11.34 GB, single=431.38 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:18:33,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.39 MB of total=11.37 GB 2014-08-20 21:18:33,453 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.39 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:18:33,456 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.39 MB, total=11.34 GB, single=433.15 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:18:39,176 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:18:39,176 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:18:39,176 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:18:39,176 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:18:39,176 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:45176 because read count=-1. Number of active connections: 11 2014-08-20 21:18:43,456 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.31 MB of total=11.37 GB 2014-08-20 21:18:43,757 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.31 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:18:43,761 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.31 MB, total=11.34 GB, single=432.99 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:18:53,761 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.78 MB of total=11.37 GB 2014-08-20 21:18:54,056 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.78 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:18:54,059 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.80 MB, total=11.34 GB, single=433.25 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:19:04,060 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.31 MB of total=11.37 GB 2014-08-20 21:19:04,326 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.31 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:19:04,329 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.32 MB, total=11.34 GB, single=434.17 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:19:14,330 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.16 MB of total=11.37 GB 2014-08-20 21:19:14,645 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.16 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:19:14,648 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.16 MB, total=11.34 GB, single=433.04 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:19:24,649 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.35 MB of total=11.37 GB 2014-08-20 21:19:24,951 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.35 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:19:24,981 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.35 MB, total=11.34 GB, single=431.14 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:19:34,981 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.58 MB of total=11.37 GB 2014-08-20 21:19:35,283 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.58 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:19:35,287 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.58 MB, total=11.34 GB, single=431.01 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:19:45,309 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.86 MB of total=11.37 GB 2014-08-20 21:19:45,612 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.86 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:19:45,615 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.86 MB, total=11.34 GB, single=432.43 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:19:55,615 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.97 MB of total=11.37 GB 2014-08-20 21:19:55,926 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.97 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:19:55,930 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.97 MB, total=11.34 GB, single=433.59 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:20:05,930 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.13 MB of total=11.37 GB 2014-08-20 21:20:06,277 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.13 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:20:06,282 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.13 MB, total=11.34 GB, single=432.72 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:20:16,293 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.25 MB of total=11.37 GB 2014-08-20 21:20:16,611 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.25 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:20:16,614 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.25 MB, total=11.34 GB, single=430.13 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:20:26,614 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.08 MB of total=11.37 GB 2014-08-20 21:20:26,865 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.08 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:20:26,868 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.08 MB, total=11.34 GB, single=429.51 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:20:36,869 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.87 MB of total=11.37 GB 2014-08-20 21:20:37,180 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.87 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:20:37,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.88 MB, total=11.34 GB, single=429.88 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:20:47,184 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.21 MB of total=11.37 GB 2014-08-20 21:20:47,502 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.21 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:20:47,531 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.21 MB, total=11.34 GB, single=431.06 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:20:57,531 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.05 MB of total=11.37 GB 2014-08-20 21:20:57,847 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.05 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:20:57,878 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.05 MB, total=11.34 GB, single=430.58 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:21:07,894 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.30 MB of total=11.37 GB 2014-08-20 21:21:08,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.30 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:21:08,204 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.31 MB, total=11.34 GB, single=431.33 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:21:18,205 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.71 MB of total=11.37 GB 2014-08-20 21:21:18,514 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:21:18,517 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.72 MB, total=11.34 GB, single=431.52 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:21:28,518 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.52 MB of total=11.37 GB 2014-08-20 21:21:28,860 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.52 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:21:28,863 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.53 MB, total=11.34 GB, single=432.10 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:21:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=604.51 MB, max=11.94 GB, blockCount=722013, accesses=47797797, hits=46587391, hitRatio=97.47%, , cachingAccesses=47797785, cachingHits=46587379, cachingHitsRatio=97.47%, evictions=532, evicted=488319, evictedPerRun=917.8928833007812 2014-08-20 21:21:38,554 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:21:38,555 DEBUG [htable-pool27-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:21:38,556 DEBUG [htable-pool27-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:21:38,556 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:45367; # active connections: 11 2014-08-20 21:21:38,556 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:21:38,560 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 179 2014-08-20 21:21:38,864 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.52 MB of total=11.37 GB 2014-08-20 21:21:39,177 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.52 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:21:39,180 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.53 MB, total=11.34 GB, single=431.37 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:21:49,180 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.84 MB of total=11.37 GB 2014-08-20 21:21:49,492 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.84 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:21:49,495 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.84 MB, total=11.34 GB, single=432.09 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:21:59,496 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.85 MB of total=11.37 GB 2014-08-20 21:21:59,812 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.85 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:21:59,817 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.86 MB, total=11.34 GB, single=432.92 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:22:09,823 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.16 MB of total=11.37 GB 2014-08-20 21:22:10,096 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.16 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:22:10,099 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.16 MB, total=11.34 GB, single=432.18 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:22:20,099 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.38 MB of total=11.37 GB 2014-08-20 21:22:20,403 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.38 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:22:20,406 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.38 MB, total=11.34 GB, single=432.22 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:22:30,426 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.66 MB of total=11.37 GB 2014-08-20 21:22:30,700 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.66 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:22:30,731 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.66 MB, total=11.34 GB, single=433.62 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:22:40,738 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.23 MB of total=11.37 GB 2014-08-20 21:22:41,044 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.23 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:22:41,074 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.24 MB, total=11.34 GB, single=433.70 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:22:51,075 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.68 MB of total=11.37 GB 2014-08-20 21:22:51,411 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.68 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:22:51,442 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.68 MB, total=11.34 GB, single=431.95 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:23:01,456 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.63 MB of total=11.37 GB 2014-08-20 21:23:01,769 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.63 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:23:01,773 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.64 MB, total=11.34 GB, single=431.90 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:23:11,774 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 21:23:12,100 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:23:12,103 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.11 MB, total=11.34 GB, single=431.80 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:23:22,111 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.83 MB of total=11.37 GB 2014-08-20 21:23:22,465 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.83 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:23:22,469 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.83 MB, total=11.34 GB, single=432.87 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:23:32,477 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.51 MB of total=11.37 GB 2014-08-20 21:23:32,795 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.51 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:23:32,826 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.51 MB, total=11.34 GB, single=432.39 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:23:39,170 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:23:39,170 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:23:39,170 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:45367 because read count=-1. Number of active connections: 11 2014-08-20 21:23:39,170 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:23:39,170 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:23:42,841 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.19 MB of total=11.37 GB 2014-08-20 21:23:43,184 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.19 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:23:43,187 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.20 MB, total=11.34 GB, single=433.28 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:23:53,191 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.26 MB of total=11.37 GB 2014-08-20 21:23:53,514 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.26 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:23:53,517 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.26 MB, total=11.34 GB, single=433.09 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:24:03,518 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.20 MB of total=11.37 GB 2014-08-20 21:24:03,805 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.20 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:24:03,836 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.20 MB, total=11.34 GB, single=433.96 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:24:13,837 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.99 MB of total=11.37 GB 2014-08-20 21:24:14,151 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.99 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:24:14,155 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.99 MB, total=11.34 GB, single=434.72 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:24:24,176 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.35 MB of total=11.37 GB 2014-08-20 21:24:24,489 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.35 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:24:24,492 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.36 MB, total=11.34 GB, single=434.61 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:24:34,492 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.71 MB of total=11.37 GB 2014-08-20 21:24:34,854 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:24:34,857 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.71 MB, total=11.34 GB, single=435.09 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:24:44,857 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.00 MB of total=11.37 GB 2014-08-20 21:24:45,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.00 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:24:45,203 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=434.80 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:24:55,203 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.56 MB of total=11.37 GB 2014-08-20 21:24:55,551 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.56 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:24:55,555 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=434.53 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:25:05,555 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.15 MB of total=11.37 GB 2014-08-20 21:25:05,841 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.15 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:25:05,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.15 MB, total=11.34 GB, single=434.48 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:25:15,845 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.15 MB of total=11.37 GB 2014-08-20 21:25:16,189 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.15 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:25:16,193 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.15 MB, total=11.34 GB, single=434.36 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:25:26,193 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.28 MB of total=11.37 GB 2014-08-20 21:25:26,509 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.28 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:25:26,512 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.28 MB, total=11.34 GB, single=433.91 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:25:36,513 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.99 MB of total=11.37 GB 2014-08-20 21:25:36,857 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.99 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:25:36,861 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=433.51 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:25:46,862 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.39 MB of total=11.37 GB 2014-08-20 21:25:47,207 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.39 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:25:47,211 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.40 MB, total=11.34 GB, single=433.72 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:25:57,234 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.57 MB of total=11.37 GB 2014-08-20 21:25:57,518 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.57 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:25:57,522 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.58 MB, total=11.34 GB, single=433.68 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:26:07,535 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.06 MB of total=11.37 GB 2014-08-20 21:26:07,820 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.06 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:26:07,851 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.07 MB, total=11.34 GB, single=431.99 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:26:17,852 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.65 MB of total=11.37 GB 2014-08-20 21:26:18,170 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.65 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:26:18,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.66 MB, total=11.34 GB, single=433.30 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:26:28,192 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.76 MB of total=11.37 GB 2014-08-20 21:26:28,482 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:26:28,485 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.76 MB, total=11.34 GB, single=432.98 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:26:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=603.62 MB, max=11.94 GB, blockCount=722068, accesses=52179934, hits=50916545, hitRatio=97.58%, , cachingAccesses=52179922, cachingHits=50916533, cachingHitsRatio=97.58%, evictions=561, evicted=541241, evictedPerRun=964.7789916992188 2014-08-20 21:26:38,486 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.87 MB of total=11.37 GB 2014-08-20 21:26:38,554 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:26:38,556 DEBUG [htable-pool28-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:26:38,557 DEBUG [htable-pool28-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:26:38,559 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:45553; # active connections: 11 2014-08-20 21:26:38,559 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:26:38,563 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 180 2014-08-20 21:26:38,803 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.87 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:26:38,806 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.88 MB, total=11.34 GB, single=433.44 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:26:48,807 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.78 MB of total=11.37 GB 2014-08-20 21:26:49,133 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.78 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:26:49,137 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.78 MB, total=11.34 GB, single=432.61 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:26:59,137 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.51 MB of total=11.37 GB 2014-08-20 21:26:59,461 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.51 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:26:59,464 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.51 MB, total=11.34 GB, single=433.04 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:27:09,490 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.00 MB of total=11.37 GB 2014-08-20 21:27:09,842 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.00 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:27:09,846 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=432.53 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:27:19,866 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.02 MB of total=11.37 GB 2014-08-20 21:27:20,160 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.02 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:27:20,163 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.02 MB, total=11.34 GB, single=432.80 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:27:30,168 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.76 MB of total=11.37 GB 2014-08-20 21:27:30,486 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:27:30,489 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.76 MB, total=11.34 GB, single=431.64 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:27:40,512 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 21:27:40,839 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:27:40,843 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.11 MB, total=11.34 GB, single=431.96 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:27:50,843 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.36 MB of total=11.37 GB 2014-08-20 21:27:51,167 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.36 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:27:51,171 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.36 MB, total=11.34 GB, single=432.42 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:28:01,195 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.79 MB of total=11.37 GB 2014-08-20 21:28:01,517 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.79 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:28:01,520 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.79 MB, total=11.34 GB, single=431.70 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:28:11,521 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.26 MB of total=11.37 GB 2014-08-20 21:28:11,837 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.26 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:28:11,840 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.26 MB, total=11.34 GB, single=431.56 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:28:21,841 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.67 MB of total=11.37 GB 2014-08-20 21:28:22,165 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.67 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:28:22,168 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.67 MB, total=11.34 GB, single=430.73 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:28:32,177 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.17 MB of total=11.37 GB 2014-08-20 21:28:32,461 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.17 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:28:32,464 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.17 MB, total=11.34 GB, single=433.11 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:28:39,357 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:28:39,357 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:28:39,357 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:28:39,357 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:45553 because read count=-1. Number of active connections: 11 2014-08-20 21:28:39,357 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:28:42,476 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.62 MB of total=11.37 GB 2014-08-20 21:28:42,788 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.62 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:28:42,791 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.63 MB, total=11.34 GB, single=434.11 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:28:52,792 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.51 MB of total=11.37 GB 2014-08-20 21:28:53,137 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.51 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:28:53,140 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.52 MB, total=11.34 GB, single=434.54 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:29:03,151 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 21:29:03,488 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:29:03,519 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.12 MB, total=11.34 GB, single=434.61 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:29:13,519 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 21:29:13,836 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:29:13,866 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.12 MB, total=11.34 GB, single=434.00 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:29:23,866 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.40 MB of total=11.37 GB 2014-08-20 21:29:24,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.40 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:29:24,176 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.40 MB, total=11.34 GB, single=434.21 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:29:34,176 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.19 MB of total=11.37 GB 2014-08-20 21:29:34,487 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.19 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:29:34,518 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.21 MB, total=11.34 GB, single=433.00 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:29:44,518 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.73 MB of total=11.37 GB 2014-08-20 21:29:44,829 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.73 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:29:44,833 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.73 MB, total=11.34 GB, single=432.73 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:29:54,833 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.85 MB of total=11.37 GB 2014-08-20 21:29:55,155 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.85 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:29:55,184 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.87 MB, total=11.34 GB, single=432.82 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:30:05,188 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.46 MB of total=11.37 GB 2014-08-20 21:30:05,501 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.46 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:30:05,504 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.48 MB, total=11.34 GB, single=431.82 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:30:15,518 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.85 MB of total=11.37 GB 2014-08-20 21:30:15,831 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.85 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:30:15,834 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.86 MB, total=11.34 GB, single=431.53 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:30:25,835 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.81 MB of total=11.37 GB 2014-08-20 21:30:26,184 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.81 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:30:26,187 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.82 MB, total=11.34 GB, single=430.94 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:30:36,187 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.25 MB of total=11.37 GB 2014-08-20 21:30:36,473 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.25 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:30:36,476 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.25 MB, total=11.34 GB, single=431.16 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:30:46,501 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.92 MB of total=11.37 GB 2014-08-20 21:30:46,782 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.92 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:30:46,785 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.92 MB, total=11.34 GB, single=432.57 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:30:56,785 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.02 MB of total=11.37 GB 2014-08-20 21:30:57,123 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.02 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:30:57,126 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.03 MB, total=11.34 GB, single=432.74 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:31:07,127 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.45 MB of total=11.37 GB 2014-08-20 21:31:07,435 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.45 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:31:07,438 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.46 MB, total=11.34 GB, single=431.62 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:31:17,454 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.05 MB of total=11.37 GB 2014-08-20 21:31:17,741 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.05 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:31:17,743 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.05 MB, total=11.34 GB, single=431.51 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:31:27,744 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.70 MB of total=11.37 GB 2014-08-20 21:31:28,055 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.70 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:31:28,058 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.70 MB, total=11.34 GB, single=432.61 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:31:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=601.76 MB, max=11.94 GB, blockCount=722186, accesses=56548783, hits=55232863, hitRatio=97.67%, , cachingAccesses=56548774, cachingHits=55232854, cachingHitsRatio=97.67%, evictions=590, evicted=593645, evictedPerRun=1006.177978515625 2014-08-20 21:31:38,059 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.62 MB of total=11.37 GB 2014-08-20 21:31:38,369 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.62 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:31:38,372 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.63 MB, total=11.34 GB, single=432.98 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:31:38,554 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:31:38,557 DEBUG [htable-pool29-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:31:38,557 DEBUG [htable-pool29-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:31:38,558 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:45743; # active connections: 11 2014-08-20 21:31:38,558 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:31:38,561 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 181 2014-08-20 21:31:48,376 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.06 MB of total=11.37 GB 2014-08-20 21:31:48,655 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.06 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:31:48,685 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.06 MB, total=11.34 GB, single=431.43 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:31:58,711 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.91 MB of total=11.37 GB 2014-08-20 21:31:58,993 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.91 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:31:58,997 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.91 MB, total=11.34 GB, single=432.45 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:32:08,997 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.86 MB of total=11.37 GB 2014-08-20 21:32:09,339 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.86 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:32:09,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.86 MB, total=11.34 GB, single=432.72 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:32:19,343 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.75 MB of total=11.37 GB 2014-08-20 21:32:19,655 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.75 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:32:19,658 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.75 MB, total=11.34 GB, single=433.22 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:32:29,666 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.76 MB of total=11.37 GB 2014-08-20 21:32:29,982 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:32:29,986 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.76 MB, total=11.34 GB, single=433.17 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:32:40,010 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.56 MB of total=11.37 GB 2014-08-20 21:32:40,322 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.56 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:32:40,325 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=434.22 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:32:50,325 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.62 MB of total=11.37 GB 2014-08-20 21:32:50,649 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.62 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:32:50,653 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.63 MB, total=11.34 GB, single=434.23 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:33:00,653 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.58 MB of total=11.37 GB 2014-08-20 21:33:00,971 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.58 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:33:01,003 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.58 MB, total=11.34 GB, single=435.65 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:33:11,011 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.10 MB of total=11.37 GB 2014-08-20 21:33:11,290 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.10 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:33:11,321 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.10 MB, total=11.34 GB, single=435.90 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:33:21,341 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.20 MB of total=11.37 GB 2014-08-20 21:33:21,643 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.20 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:33:21,674 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.21 MB, total=11.34 GB, single=435.46 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:33:31,699 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.49 MB of total=11.37 GB 2014-08-20 21:33:32,021 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.49 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:33:32,024 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.50 MB, total=11.34 GB, single=436.00 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:33:39,275 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:33:39,275 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:45743 because read count=-1. Number of active connections: 11 2014-08-20 21:33:39,275 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:33:39,275 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:33:39,275 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:33:42,039 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.64 MB of total=11.37 GB 2014-08-20 21:33:42,359 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.64 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:33:42,363 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.64 MB, total=11.34 GB, single=436.92 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:33:52,370 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.30 MB of total=11.37 GB 2014-08-20 21:33:52,655 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.30 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:33:52,659 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.31 MB, total=11.34 GB, single=437.32 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:34:02,668 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.14 MB of total=11.37 GB 2014-08-20 21:34:02,984 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.14 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:34:02,987 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.15 MB, total=11.34 GB, single=438.77 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:34:12,988 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.37 MB of total=11.37 GB 2014-08-20 21:34:13,267 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.37 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:34:13,270 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.37 MB, total=11.34 GB, single=438.12 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:34:23,279 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.30 MB of total=11.37 GB 2014-08-20 21:34:23,570 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.30 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:34:23,574 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.31 MB, total=11.34 GB, single=437.70 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:34:33,574 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.89 MB of total=11.37 GB 2014-08-20 21:34:33,903 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.89 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:34:33,906 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.89 MB, total=11.34 GB, single=438.50 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:34:43,907 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.42 MB of total=11.37 GB 2014-08-20 21:34:44,201 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.42 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:34:44,204 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.42 MB, total=11.34 GB, single=438.92 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:34:54,247 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.54 MB of total=11.37 GB 2014-08-20 21:34:54,567 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.54 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:34:54,570 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.55 MB, total=11.34 GB, single=439.19 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:35:04,571 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.05 MB of total=11.37 GB 2014-08-20 21:35:04,891 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.05 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:35:04,921 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.05 MB, total=11.34 GB, single=436.84 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:35:14,921 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.65 MB of total=11.37 GB 2014-08-20 21:35:15,213 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.65 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:35:15,216 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.67 MB, total=11.34 GB, single=436.97 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:35:25,217 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.99 MB of total=11.37 GB 2014-08-20 21:35:25,509 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.99 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:35:25,513 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=436.77 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:35:35,513 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.80 MB of total=11.37 GB 2014-08-20 21:35:35,829 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.80 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:35:35,832 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=436.19 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:35:45,832 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.49 MB of total=11.37 GB 2014-08-20 21:35:46,164 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.49 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:35:46,168 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.50 MB, total=11.34 GB, single=437.93 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:35:56,174 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.89 MB of total=11.37 GB 2014-08-20 21:35:56,499 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.89 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:35:56,502 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.91 MB, total=11.34 GB, single=437.23 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:36:06,502 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.76 MB of total=11.37 GB 2014-08-20 21:36:06,843 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:36:06,847 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.77 MB, total=11.34 GB, single=437.02 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:36:16,849 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.88 MB of total=11.37 GB 2014-08-20 21:36:17,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.88 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:36:17,177 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.89 MB, total=11.34 GB, single=436.29 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:36:27,196 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.11 MB of total=11.37 GB 2014-08-20 21:36:27,481 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:36:27,485 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.13 MB, total=11.34 GB, single=435.49 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:36:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=600.91 MB, max=11.94 GB, blockCount=722238, accesses=60931205, hits=59562365, hitRatio=97.75%, , cachingAccesses=60931193, cachingHits=59562353, cachingHitsRatio=97.75%, evictions=619, evicted=646513, evictedPerRun=1044.447509765625 2014-08-20 21:36:37,495 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.72 MB of total=11.37 GB 2014-08-20 21:36:37,858 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.72 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:36:37,862 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.72 MB, total=11.34 GB, single=435.26 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:36:38,554 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:36:38,556 DEBUG [htable-pool30-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:36:38,557 DEBUG [htable-pool30-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:36:38,557 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:45932; # active connections: 11 2014-08-20 21:36:38,558 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:36:38,561 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 182 2014-08-20 21:36:47,862 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.18 MB of total=11.37 GB 2014-08-20 21:36:48,199 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.18 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:36:48,202 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.20 MB, total=11.34 GB, single=434.93 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:36:58,220 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.59 MB of total=11.37 GB 2014-08-20 21:36:58,499 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.59 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:36:58,502 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.59 MB, total=11.34 GB, single=434.30 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:37:08,502 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.34 MB of total=11.37 GB 2014-08-20 21:37:08,815 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.34 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:37:08,819 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.35 MB, total=11.34 GB, single=435.57 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:37:18,831 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.42 MB of total=11.37 GB 2014-08-20 21:37:19,140 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.42 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:37:19,144 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.42 MB, total=11.34 GB, single=436.38 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:37:29,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.27 MB of total=11.37 GB 2014-08-20 21:37:29,435 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.27 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:37:29,439 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.27 MB, total=11.34 GB, single=436.83 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:37:39,440 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.89 MB of total=11.37 GB 2014-08-20 21:37:39,762 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.89 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:37:39,765 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.89 MB, total=11.34 GB, single=435.77 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:37:49,783 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.22 MB of total=11.37 GB 2014-08-20 21:37:50,069 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.22 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:37:50,072 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.23 MB, total=11.34 GB, single=436.54 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:38:00,083 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.36 MB of total=11.37 GB 2014-08-20 21:38:00,414 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.36 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:38:00,417 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.36 MB, total=11.34 GB, single=435.85 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:38:10,429 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.65 MB of total=11.37 GB 2014-08-20 21:38:10,711 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.65 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:38:10,715 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.65 MB, total=11.34 GB, single=436.40 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:38:20,715 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.70 MB of total=11.37 GB 2014-08-20 21:38:21,033 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.70 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:38:21,036 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.70 MB, total=11.34 GB, single=436.55 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:38:31,037 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.97 MB of total=11.37 GB 2014-08-20 21:38:31,375 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.97 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:38:31,379 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.98 MB, total=11.34 GB, single=434.99 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:38:39,489 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:38:39,490 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:45932 because read count=-1. Number of active connections: 11 2014-08-20 21:38:39,490 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:38:39,490 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:38:39,490 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:38:41,379 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.80 MB of total=11.37 GB 2014-08-20 21:38:41,693 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.80 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:38:41,697 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=434.21 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:38:51,697 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.18 MB of total=11.37 GB 2014-08-20 21:38:51,983 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.18 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:38:51,986 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.20 MB, total=11.34 GB, single=435.93 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:39:01,993 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.48 MB of total=11.37 GB 2014-08-20 21:39:02,312 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.48 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:39:02,316 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.49 MB, total=11.34 GB, single=435.99 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:39:12,327 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.83 MB of total=11.37 GB 2014-08-20 21:39:12,609 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.83 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:39:12,612 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.84 MB, total=11.34 GB, single=434.94 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:39:22,613 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.39 MB of total=11.37 GB 2014-08-20 21:39:22,962 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.39 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:39:22,965 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.40 MB, total=11.34 GB, single=434.13 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:39:32,966 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.73 MB of total=11.37 GB 2014-08-20 21:39:33,309 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.73 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:39:33,312 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.74 MB, total=11.34 GB, single=434.84 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:39:43,326 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.33 MB of total=11.37 GB 2014-08-20 21:39:43,648 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.33 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:39:43,652 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.34 MB, total=11.34 GB, single=434.44 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:39:53,679 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.67 MB of total=11.37 GB 2014-08-20 21:39:53,967 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.67 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:39:53,971 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.68 MB, total=11.34 GB, single=432.48 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:40:03,971 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.38 MB of total=11.37 GB 2014-08-20 21:40:04,250 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.38 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:40:04,253 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.40 MB, total=11.34 GB, single=430.72 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:40:14,264 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.07 MB of total=11.37 GB 2014-08-20 21:40:14,571 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.07 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:40:14,574 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.09 MB, total=11.34 GB, single=430.18 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:40:24,575 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.20 MB of total=11.37 GB 2014-08-20 21:40:24,914 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.20 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:40:24,918 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.21 MB, total=11.34 GB, single=430.42 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:40:34,924 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.50 MB of total=11.37 GB 2014-08-20 21:40:35,236 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.50 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:40:35,240 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.51 MB, total=11.34 GB, single=430.76 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:40:45,240 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.74 MB of total=11.37 GB 2014-08-20 21:40:45,551 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.74 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:40:45,554 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.75 MB, total=11.34 GB, single=429.21 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:40:55,568 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.54 MB of total=11.37 GB 2014-08-20 21:40:55,874 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.54 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:40:55,877 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=428.65 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:41:05,877 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.26 MB of total=11.37 GB 2014-08-20 21:41:06,201 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.26 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:41:06,231 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.27 MB, total=11.34 GB, single=428.43 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:41:16,232 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.18 MB of total=11.37 GB 2014-08-20 21:41:16,548 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.18 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:41:16,551 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.19 MB, total=11.34 GB, single=429.19 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:41:26,552 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.50 MB of total=11.37 GB 2014-08-20 21:41:26,872 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.50 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:41:26,875 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.51 MB, total=11.34 GB, single=427.96 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:41:30,839 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.35 GB, freeSize=599.37 MB, max=11.94 GB, blockCount=722337, accesses=65301997, hits=63880535, hitRatio=97.82%, , cachingAccesses=65301988, cachingHits=63880526, cachingHitsRatio=97.82%, evictions=648, evicted=699034, evictedPerRun=1078.7562255859375 2014-08-20 21:41:36,879 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.97 MB of total=11.37 GB 2014-08-20 21:41:37,206 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.97 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:41:37,209 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.98 MB, total=11.34 GB, single=427.41 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:41:38,572 DEBUG [htable-pool31-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:41:38,572 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:41:38,572 DEBUG [htable-pool31-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:41:38,573 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:46132; # active connections: 11 2014-08-20 21:41:38,573 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:41:38,577 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 183 2014-08-20 21:41:47,209 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.99 MB of total=11.37 GB 2014-08-20 21:41:47,559 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.99 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:41:47,563 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=427.39 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:41:57,588 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.10 MB of total=11.37 GB 2014-08-20 21:41:57,912 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.10 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:41:57,916 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.11 MB, total=11.34 GB, single=427.12 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:42:07,937 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.37 MB of total=11.37 GB 2014-08-20 21:42:08,224 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.37 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:42:08,227 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.39 MB, total=11.34 GB, single=427.69 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:42:18,227 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.43 MB of total=11.37 GB 2014-08-20 21:42:18,546 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.43 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:42:18,577 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.44 MB, total=11.34 GB, single=427.66 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:42:28,676 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.05 MB of total=11.37 GB 2014-08-20 21:42:28,960 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.05 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:42:28,991 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.07 MB, total=11.34 GB, single=427.67 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:42:39,003 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.96 MB of total=11.37 GB 2014-08-20 21:42:39,325 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.96 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:42:39,329 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.97 MB, total=11.34 GB, single=428.12 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:42:49,329 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.38 MB of total=11.37 GB 2014-08-20 21:42:49,657 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.38 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:42:49,660 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.39 MB, total=11.34 GB, single=429.49 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:42:59,661 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.96 MB of total=11.37 GB 2014-08-20 21:43:00,018 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.96 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:43:00,021 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.96 MB, total=11.34 GB, single=430.51 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:43:10,040 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.13 MB of total=11.37 GB 2014-08-20 21:43:10,360 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.13 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:43:10,364 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.13 MB, total=11.34 GB, single=430.46 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:43:20,369 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.29 MB of total=11.37 GB 2014-08-20 21:43:20,732 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.29 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:43:20,736 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.29 MB, total=11.34 GB, single=429.90 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:43:30,753 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.17 MB of total=11.37 GB 2014-08-20 21:43:31,043 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.17 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:43:31,047 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.18 MB, total=11.34 GB, single=430.86 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:43:39,291 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:43:39,291 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:46132 because read count=-1. Number of active connections: 11 2014-08-20 21:43:39,291 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:43:39,292 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:43:39,292 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:43:41,047 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.24 MB of total=11.37 GB 2014-08-20 21:43:41,360 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.24 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:43:41,364 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.24 MB, total=11.34 GB, single=431.42 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:43:51,373 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.86 MB of total=11.37 GB 2014-08-20 21:43:51,693 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.86 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:43:51,696 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.86 MB, total=11.34 GB, single=432.17 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:44:01,696 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.19 MB of total=11.37 GB 2014-08-20 21:44:02,011 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.19 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:44:02,015 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.20 MB, total=11.34 GB, single=431.72 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:44:12,015 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.17 MB of total=11.37 GB 2014-08-20 21:44:12,328 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.17 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:44:12,331 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.18 MB, total=11.34 GB, single=431.02 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:44:22,331 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.00 MB of total=11.37 GB 2014-08-20 21:44:22,668 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.00 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:44:22,672 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.00 MB, total=11.34 GB, single=431.35 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:44:32,680 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.73 MB of total=11.37 GB 2014-08-20 21:44:33,035 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.73 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:44:33,039 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.73 MB, total=11.34 GB, single=429.75 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52978 because read count=-1. Number of active connections: 10 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52982 because read count=-1. Number of active connections: 9 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52976 because read count=-1. Number of active connections: 8 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52988 because read count=-1. Number of active connections: 7 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52977 because read count=-1. Number of active connections: 9 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,388 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52986 because read count=-1. Number of active connections: 5 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,388 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52985 because read count=-1. Number of active connections: 4 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 21:44:39,388 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52987 because read count=-1. Number of active connections: 3 2014-08-20 21:44:39,387 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52983 because read count=-1. Number of active connections: 9 2014-08-20 21:44:39,388 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:52984 because read count=-1. Number of active connections: 3 2014-08-20 21:44:43,039 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 17.97 MB of total=11.36 GB 2014-08-20 21:44:43,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 17.97 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 21:44:43,184 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=17.97 MB, total=11.34 GB, single=430.96 MB, multi=10.92 GB, memory=91.23 KB 2014-08-20 21:44:53,185 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.92 KB of total=11.34 GB 2014-08-20 21:45:03,185 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.92 KB of total=11.34 GB 2014-08-20 21:45:13,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.92 KB of total=11.34 GB 2014-08-20 21:45:23,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.92 KB of total=11.34 GB 2014-08-20 21:45:33,187 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -2.92 KB of total=11.34 GB 2014-08-20 21:45:42,023 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53309; # active connections: 1 2014-08-20 21:45:42,074 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53310; # active connections: 2 2014-08-20 21:45:42,129 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53309 because read count=-1. Number of active connections: 2 2014-08-20 21:45:42,129 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53310 because read count=-1. Number of active connections: 2 2014-08-20 21:45:42,403 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53322; # active connections: 1 2014-08-20 21:45:42,403 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53323; # active connections: 2 2014-08-20 21:45:42,413 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53325; # active connections: 3 2014-08-20 21:45:42,414 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53327; # active connections: 4 2014-08-20 21:45:42,414 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53326; # active connections: 5 2014-08-20 21:45:42,414 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53328; # active connections: 6 2014-08-20 21:45:42,415 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53329; # active connections: 7 2014-08-20 21:45:42,415 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53330; # active connections: 8 2014-08-20 21:45:42,415 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53331; # active connections: 9 2014-08-20 21:45:42,416 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.56:53332; # active connections: 10 2014-08-20 21:45:43,187 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 1.63 MB of total=11.34 GB 2014-08-20 21:45:43,412 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 1.63 MB from BlockBucket{name=multi, totalSize=10.91 GB, bucketSize=5.67 GB} 2014-08-20 21:45:43,413 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=1.63 MB, total=11.34 GB, single=430.98 MB, multi=10.91 GB, memory=91.23 KB 2014-08-20 21:45:53,427 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.66 MB of total=11.37 GB 2014-08-20 21:45:53,717 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.66 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:45:53,748 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.66 MB, total=11.34 GB, single=430.45 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:46:03,749 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.92 MB of total=11.37 GB 2014-08-20 21:46:04,078 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.92 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:46:04,083 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.92 MB, total=11.34 GB, single=430.53 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:46:14,100 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.14 MB of total=11.37 GB 2014-08-20 21:46:14,434 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.14 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:46:14,437 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.15 MB, total=11.34 GB, single=431.47 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:46:24,438 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.78 MB of total=11.37 GB 2014-08-20 21:46:24,760 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.78 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:46:24,791 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.78 MB, total=11.34 GB, single=432.37 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:46:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=594.09 MB, max=11.94 GB, blockCount=722666, accesses=68731052, hits=67268142, hitRatio=97.87%, , cachingAccesses=68731040, cachingHits=67268130, cachingHitsRatio=97.87%, evictions=677, evicted=740146, evictedPerRun=1093.2733154296875 2014-08-20 21:46:34,791 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.24 MB of total=11.37 GB 2014-08-20 21:46:35,105 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.24 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:46:35,108 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.24 MB, total=11.34 GB, single=432.18 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:46:38,572 DEBUG [htable-pool32-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:46:38,572 DEBUG [htable-pool32-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:46:38,574 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:46:38,574 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:46326; # active connections: 11 2014-08-20 21:46:38,574 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:46:38,608 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 236 2014-08-20 21:46:45,109 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.27 MB of total=11.37 GB 2014-08-20 21:46:45,419 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.27 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:46:45,423 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.27 MB, total=11.34 GB, single=432.68 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:46:55,423 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.15 MB of total=11.37 GB 2014-08-20 21:46:55,742 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.15 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:46:55,746 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.15 MB, total=11.34 GB, single=433.04 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:47:05,759 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.89 MB of total=11.37 GB 2014-08-20 21:47:06,082 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.89 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:47:06,086 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.89 MB, total=11.34 GB, single=432.51 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:47:16,086 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.58 MB of total=11.37 GB 2014-08-20 21:47:16,438 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.58 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:47:16,441 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.58 MB, total=11.34 GB, single=431.62 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:47:26,441 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.75 MB of total=11.37 GB 2014-08-20 21:47:26,758 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.75 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:47:26,761 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.75 MB, total=11.34 GB, single=431.94 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:47:36,762 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.70 MB of total=11.37 GB 2014-08-20 21:47:37,082 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.70 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:47:37,085 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.70 MB, total=11.34 GB, single=432.34 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:47:47,110 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.92 MB of total=11.37 GB 2014-08-20 21:47:47,431 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.92 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:47:47,434 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.92 MB, total=11.34 GB, single=433.26 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:47:57,447 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.45 MB of total=11.37 GB 2014-08-20 21:47:57,734 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.45 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:47:57,765 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.45 MB, total=11.34 GB, single=431.86 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:48:07,765 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.17 MB of total=11.37 GB 2014-08-20 21:48:08,077 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.17 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:48:08,081 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.17 MB, total=11.34 GB, single=431.75 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:48:18,106 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.42 MB of total=11.37 GB 2014-08-20 21:48:18,424 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.42 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:48:18,428 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.42 MB, total=11.34 GB, single=432.98 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:48:28,429 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.27 MB of total=11.37 GB 2014-08-20 21:48:28,764 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.27 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:48:28,767 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.28 MB, total=11.34 GB, single=433.15 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:48:38,767 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.20 MB of total=11.37 GB 2014-08-20 21:48:39,047 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.20 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:48:39,050 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.21 MB, total=11.34 GB, single=431.16 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:48:39,051 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:48:39,051 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:48:39,051 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:46326 because read count=-1. Number of active connections: 11 2014-08-20 21:48:39,051 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:48:39,051 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:48:49,050 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.42 MB of total=11.37 GB 2014-08-20 21:48:49,330 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.42 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:48:49,360 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.43 MB, total=11.34 GB, single=430.52 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:48:59,361 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.39 MB of total=11.37 GB 2014-08-20 21:48:59,697 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.39 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:48:59,701 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.40 MB, total=11.34 GB, single=431.12 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:49:09,727 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.94 MB of total=11.37 GB 2014-08-20 21:49:10,007 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.94 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:49:10,011 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.95 MB, total=11.34 GB, single=432.47 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:49:20,012 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.08 MB of total=11.37 GB 2014-08-20 21:49:20,301 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.08 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:49:20,332 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.08 MB, total=11.34 GB, single=433.60 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:49:30,346 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.68 MB of total=11.37 GB 2014-08-20 21:49:30,628 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.68 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:49:30,631 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.68 MB, total=11.34 GB, single=434.22 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:49:40,631 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.33 MB of total=11.37 GB 2014-08-20 21:49:40,919 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.33 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:49:40,922 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.34 MB, total=11.34 GB, single=434.91 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:49:50,930 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.90 MB of total=11.37 GB 2014-08-20 21:49:51,183 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.90 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:49:51,187 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.91 MB, total=11.34 GB, single=436.12 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:50:01,204 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.17 MB of total=11.37 GB 2014-08-20 21:50:01,500 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.17 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:50:01,530 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.17 MB, total=11.34 GB, single=435.12 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:50:11,530 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.87 MB of total=11.37 GB 2014-08-20 21:50:11,854 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.87 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:50:11,858 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.87 MB, total=11.34 GB, single=435.32 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:50:21,859 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.73 MB of total=11.37 GB 2014-08-20 21:50:22,182 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.73 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:50:22,212 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.73 MB, total=11.34 GB, single=435.40 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:50:32,212 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.35 MB of total=11.37 GB 2014-08-20 21:50:32,540 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.35 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:50:32,544 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.36 MB, total=11.34 GB, single=435.58 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:50:42,567 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.63 MB of total=11.37 GB 2014-08-20 21:50:42,896 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.63 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:50:42,899 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.63 MB, total=11.34 GB, single=434.62 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:50:52,899 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.98 MB of total=11.37 GB 2014-08-20 21:50:53,215 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.98 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:50:53,218 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.98 MB, total=11.34 GB, single=434.35 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:51:03,218 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.84 MB of total=11.37 GB 2014-08-20 21:51:03,546 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.84 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:51:03,549 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.84 MB, total=11.34 GB, single=434.64 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:51:13,563 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.03 MB of total=11.37 GB 2014-08-20 21:51:13,853 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.03 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:51:13,856 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.04 MB, total=11.34 GB, single=435.18 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:51:23,856 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.02 MB of total=11.37 GB 2014-08-20 21:51:24,177 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.02 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:51:24,181 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.02 MB, total=11.34 GB, single=435.47 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:51:30,825 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=591.48 MB, max=11.94 GB, blockCount=722829, accesses=73025021, hits=71509917, hitRatio=97.93%, , cachingAccesses=73025009, cachingHits=71509905, cachingHitsRatio=97.93%, evictions=706, evicted=792172, evictedPerRun=1122.056640625 2014-08-20 21:51:34,186 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.85 MB of total=11.37 GB 2014-08-20 21:51:34,472 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.85 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:51:34,475 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.85 MB, total=11.34 GB, single=434.61 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:51:36,465 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] regionserver.LogRoller: Hlog roll period 3600000ms elapsed 2014-08-20 21:51:36,705 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] wal.FSHLog: Rolled WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567894740 with entries=0, filesize=91 B; new WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408571496465 2014-08-20 21:51:36,705 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] wal.FSHLog: WAL file ready for archiving hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567894740 2014-08-20 21:51:38,572 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:51:38,573 DEBUG [htable-pool33-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:51:38,573 DEBUG [htable-pool33-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:51:38,573 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:46511; # active connections: 11 2014-08-20 21:51:38,574 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:51:38,607 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 237 2014-08-20 21:51:41,127 DEBUG [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] regionserver.LogRoller: Hlog roll period 3600000ms elapsed 2014-08-20 21:51:41,319 INFO [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] wal.FSHLog: Slow sync cost: 115 ms, current pipeline: [206.190.52.55:50010] 2014-08-20 21:51:41,434 INFO [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] wal.FSHLog: Rolled WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567899250.meta with entries=2, filesize=383 B; new WAL /apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408571501128.meta 2014-08-20 21:51:41,435 DEBUG [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] wal.FSHLog: WAL file ready for archiving hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564297828.meta 2014-08-20 21:51:41,435 DEBUG [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] wal.FSHLog: WAL file ready for archiving hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615/hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567899250.meta 2014-08-20 21:51:44,475 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.69 MB of total=11.37 GB 2014-08-20 21:51:44,798 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.69 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:51:44,829 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.69 MB, total=11.34 GB, single=433.78 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:51:54,829 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.35 MB of total=11.37 GB 2014-08-20 21:51:55,152 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.35 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:51:55,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.36 MB, total=11.34 GB, single=434.39 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:52:05,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.01 MB of total=11.37 GB 2014-08-20 21:52:05,472 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.01 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:52:05,476 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.02 MB, total=11.34 GB, single=433.35 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:52:15,476 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.57 MB of total=11.37 GB 2014-08-20 21:52:15,829 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.57 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:52:15,832 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.59 MB, total=11.34 GB, single=433.17 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:52:25,833 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.84 MB of total=11.37 GB 2014-08-20 21:52:26,119 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.84 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:52:26,122 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.84 MB, total=11.34 GB, single=433.74 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:52:36,123 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 21:52:36,436 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:52:36,440 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.11 MB, total=11.34 GB, single=434.09 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:52:46,440 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.24 MB of total=11.37 GB 2014-08-20 21:52:46,734 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.24 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:52:46,737 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.25 MB, total=11.34 GB, single=434.83 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:52:56,738 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.38 MB of total=11.37 GB 2014-08-20 21:52:57,066 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.38 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:52:57,069 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.38 MB, total=11.34 GB, single=433.06 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:53:07,070 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.82 MB of total=11.37 GB 2014-08-20 21:53:07,386 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.82 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:53:07,390 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.82 MB, total=11.34 GB, single=432.98 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:53:17,390 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.38 MB of total=11.37 GB 2014-08-20 21:53:17,766 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.38 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:53:17,769 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.38 MB, total=11.34 GB, single=431.67 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:53:27,769 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.54 MB of total=11.37 GB 2014-08-20 21:53:28,100 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.54 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:53:28,104 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.54 MB, total=11.34 GB, single=431.40 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:53:38,104 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.70 MB of total=11.37 GB 2014-08-20 21:53:38,437 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.70 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:53:38,441 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.70 MB, total=11.34 GB, single=430.97 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:53:39,237 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:53:39,238 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:46511 because read count=-1. Number of active connections: 11 2014-08-20 21:53:39,238 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:53:39,238 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:53:39,238 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:53:48,441 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.81 MB of total=11.37 GB 2014-08-20 21:53:48,783 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.81 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:53:48,787 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=431.76 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:53:58,802 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.38 MB of total=11.37 GB 2014-08-20 21:53:59,136 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.38 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:53:59,167 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.38 MB, total=11.34 GB, single=430.65 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:54:09,167 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.16 MB of total=11.37 GB 2014-08-20 21:54:09,511 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.16 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:54:09,515 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.16 MB, total=11.34 GB, single=431.21 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:54:19,530 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.12 MB of total=11.37 GB 2014-08-20 21:54:19,902 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.12 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:54:19,906 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.12 MB, total=11.34 GB, single=431.05 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:54:29,906 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 30.04 MB of total=11.37 GB 2014-08-20 21:54:30,231 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 30.04 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:54:30,235 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=30.04 MB, total=11.34 GB, single=432.10 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:54:40,235 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.29 MB of total=11.37 GB 2014-08-20 21:54:40,552 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.29 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:54:40,555 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.29 MB, total=11.34 GB, single=432.53 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:54:50,558 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.16 MB of total=11.37 GB 2014-08-20 21:54:50,888 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.16 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:54:50,919 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.17 MB, total=11.34 GB, single=432.93 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:55:00,919 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.32 MB of total=11.37 GB 2014-08-20 21:55:01,218 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.32 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:55:01,222 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.34 MB, total=11.34 GB, single=433.38 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:55:11,222 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.51 MB of total=11.37 GB 2014-08-20 21:55:11,588 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.51 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:55:11,591 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.53 MB, total=11.34 GB, single=432.69 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:55:21,612 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.11 MB of total=11.37 GB 2014-08-20 21:55:21,929 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:55:21,932 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.11 MB, total=11.34 GB, single=431.96 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:55:31,943 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.50 MB of total=11.37 GB 2014-08-20 21:55:32,266 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.50 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:55:32,270 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.52 MB, total=11.34 GB, single=430.30 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:55:42,270 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.24 MB of total=11.37 GB 2014-08-20 21:55:42,599 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.24 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:55:42,602 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.26 MB, total=11.34 GB, single=431.45 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:55:52,626 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.49 MB of total=11.37 GB 2014-08-20 21:55:52,951 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.49 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:55:52,954 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.49 MB, total=11.34 GB, single=432.55 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:56:02,976 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.31 MB of total=11.37 GB 2014-08-20 21:56:03,300 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.31 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:56:03,303 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.31 MB, total=11.34 GB, single=433.33 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:56:13,303 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 21:56:13,593 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:56:13,596 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.12 MB, total=11.34 GB, single=433.57 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:56:23,596 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.25 MB of total=11.37 GB 2014-08-20 21:56:23,913 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.25 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:56:23,916 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.25 MB, total=11.34 GB, single=433.43 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:56:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=590.90 MB, max=11.94 GB, blockCount=722865, accesses=77333303, hits=75766375, hitRatio=97.97%, , cachingAccesses=77333293, cachingHits=75766365, cachingHitsRatio=97.97%, evictions=735, evicted=843947, evictedPerRun=1148.2271728515625 2014-08-20 21:56:33,917 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.64 MB of total=11.37 GB 2014-08-20 21:56:34,236 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.64 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:56:34,239 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.64 MB, total=11.34 GB, single=432.40 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:56:38,583 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 21:56:38,583 DEBUG [htable-pool34-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 21:56:38,583 DEBUG [htable-pool34-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:56:38,583 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:46710; # active connections: 11 2014-08-20 21:56:38,584 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 21:56:38,587 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 238 2014-08-20 21:56:44,240 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.33 MB of total=11.37 GB 2014-08-20 21:56:44,598 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.33 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:56:44,601 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.33 MB, total=11.34 GB, single=432.56 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:56:54,603 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.71 MB of total=11.37 GB 2014-08-20 21:56:54,893 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:56:54,896 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.72 MB, total=11.34 GB, single=432.74 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:57:04,914 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.14 MB of total=11.37 GB 2014-08-20 21:57:05,230 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.14 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:57:05,234 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.14 MB, total=11.34 GB, single=430.86 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:57:15,234 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.76 MB of total=11.37 GB 2014-08-20 21:57:15,554 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.76 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:57:15,557 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.76 MB, total=11.34 GB, single=431.78 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:57:25,577 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.14 MB of total=11.37 GB 2014-08-20 21:57:25,897 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.14 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:57:25,901 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.14 MB, total=11.34 GB, single=430.47 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:57:35,901 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 27.92 MB of total=11.37 GB 2014-08-20 21:57:36,221 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 27.92 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:57:36,224 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=27.92 MB, total=11.34 GB, single=430.06 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:57:46,225 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.16 MB of total=11.37 GB 2014-08-20 21:57:46,549 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.16 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:57:46,552 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.16 MB, total=11.34 GB, single=431.46 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:57:56,577 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.04 MB of total=11.37 GB 2014-08-20 21:57:56,893 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.04 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:57:56,896 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.05 MB, total=11.34 GB, single=429.82 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:58:06,897 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.60 MB of total=11.37 GB 2014-08-20 21:58:07,217 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.60 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:58:07,220 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.62 MB, total=11.34 GB, single=430.99 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:58:17,221 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.44 MB of total=11.37 GB 2014-08-20 21:58:17,590 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.44 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 21:58:17,593 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.44 MB, total=11.34 GB, single=429.87 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 21:58:27,594 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.73 MB of total=11.37 GB 2014-08-20 21:58:27,910 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.73 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:58:27,913 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.73 MB, total=11.34 GB, single=431.15 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:58:37,913 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.51 MB of total=11.37 GB 2014-08-20 21:58:38,200 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.51 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:58:38,203 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.52 MB, total=11.34 GB, single=432.45 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:58:39,370 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 21:58:39,370 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 21:58:39,370 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:46710 because read count=-1. Number of active connections: 11 2014-08-20 21:58:39,370 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 21:58:39,370 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 21:58:48,204 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.21 MB of total=11.37 GB 2014-08-20 21:58:48,523 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.21 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:58:48,526 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.23 MB, total=11.34 GB, single=433.27 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:58:58,527 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.69 MB of total=11.37 GB 2014-08-20 21:58:58,873 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.69 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:58:58,876 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.70 MB, total=11.34 GB, single=433.68 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:59:08,877 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.74 MB of total=11.37 GB 2014-08-20 21:59:09,231 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.74 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:59:09,235 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.76 MB, total=11.34 GB, single=435.41 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:59:19,235 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.88 MB of total=11.37 GB 2014-08-20 21:59:19,567 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.88 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:59:19,570 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.89 MB, total=11.34 GB, single=434.29 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:59:29,570 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.80 MB of total=11.37 GB 2014-08-20 21:59:29,937 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.80 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:59:29,940 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.81 MB, total=11.34 GB, single=435.58 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:59:39,941 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.32 MB of total=11.37 GB 2014-08-20 21:59:40,306 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.32 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:59:40,310 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.33 MB, total=11.34 GB, single=435.47 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 21:59:50,311 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.54 MB of total=11.37 GB 2014-08-20 21:59:50,641 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.54 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 21:59:50,644 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.56 MB, total=11.34 GB, single=434.85 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:00:00,667 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.14 MB of total=11.37 GB 2014-08-20 22:00:00,997 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.14 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:00:01,000 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.16 MB, total=11.34 GB, single=433.65 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:00:11,000 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.88 MB of total=11.37 GB 2014-08-20 22:00:11,368 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.88 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:00:11,372 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.90 MB, total=11.34 GB, single=435.42 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:00:21,394 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.17 MB of total=11.37 GB 2014-08-20 22:00:21,718 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.17 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:00:21,721 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.19 MB, total=11.34 GB, single=434.43 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:00:31,748 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.40 MB of total=11.37 GB 2014-08-20 22:00:32,069 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.40 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:00:32,073 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.41 MB, total=11.34 GB, single=435.87 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:00:42,073 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.37 MB of total=11.37 GB 2014-08-20 22:00:42,373 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.37 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:00:42,377 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.38 MB, total=11.34 GB, single=435.09 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:00:52,394 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.64 MB of total=11.37 GB 2014-08-20 22:00:52,690 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.64 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:00:52,694 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.64 MB, total=11.34 GB, single=436.03 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:01:02,717 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.60 MB of total=11.37 GB 2014-08-20 22:01:03,004 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.60 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:01:03,008 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.60 MB, total=11.34 GB, single=436.03 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:01:13,008 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.43 MB of total=11.37 GB 2014-08-20 22:01:13,324 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.43 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:01:13,328 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.43 MB, total=11.34 GB, single=435.33 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:01:23,341 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.62 MB of total=11.37 GB 2014-08-20 22:01:23,666 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.62 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:01:23,669 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.62 MB, total=11.34 GB, single=436.41 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:01:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.36 GB, freeSize=590.33 MB, max=11.94 GB, blockCount=722901, accesses=81632081, hits=80013126, hitRatio=98.02%, , cachingAccesses=81632075, cachingHits=80013120, cachingHitsRatio=98.02%, evictions=764, evicted=895931, evictedPerRun=1172.6845703125 2014-08-20 22:01:33,670 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.71 MB of total=11.37 GB 2014-08-20 22:01:33,986 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.71 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:01:33,989 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.72 MB, total=11.34 GB, single=434.94 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:01:38,598 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 22:01:38,598 DEBUG [htable-pool35-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 22:01:38,598 DEBUG [htable-pool35-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 22:01:38,599 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:46895; # active connections: 11 2014-08-20 22:01:38,599 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 22:01:38,603 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 239 2014-08-20 22:01:44,007 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.65 MB of total=11.37 GB 2014-08-20 22:01:44,332 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.65 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:01:44,336 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.65 MB, total=11.34 GB, single=434.78 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:01:54,364 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.40 MB of total=11.37 GB 2014-08-20 22:01:54,666 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.40 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:01:54,670 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.40 MB, total=11.34 GB, single=433.82 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:02:04,675 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.09 MB of total=11.37 GB 2014-08-20 22:02:05,005 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.09 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:02:05,008 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.09 MB, total=11.34 GB, single=431.83 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:02:15,009 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.57 MB of total=11.37 GB 2014-08-20 22:02:15,366 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.57 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:02:15,370 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.57 MB, total=11.34 GB, single=432.67 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:02:25,381 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.87 MB of total=11.37 GB 2014-08-20 22:02:25,719 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.87 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:02:25,722 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.88 MB, total=11.34 GB, single=433.04 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:02:33,435 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] master.ReplicationLogCleaner: Didn't find this log in ZK, deleting: hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408564297828.meta 2014-08-20 22:02:33,450 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] master.ReplicationLogCleaner: Didn't find this log in ZK, deleting: hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567894740 2014-08-20 22:02:33,458 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] master.ReplicationLogCleaner: Didn't find this log in ZK, deleting: hor17n36.gq1.ygridcore.net%2C16020%2C1408564290615.1408567899250.meta 2014-08-20 22:02:35,722 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.57 MB of total=11.37 GB 2014-08-20 22:02:36,086 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.57 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:02:36,089 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.57 MB, total=11.34 GB, single=432.18 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:02:46,112 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.65 MB of total=11.37 GB 2014-08-20 22:02:46,456 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.65 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:02:46,460 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.65 MB, total=11.34 GB, single=432.13 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:02:56,460 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.01 MB of total=11.37 GB 2014-08-20 22:02:56,782 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.01 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:02:56,785 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.01 MB, total=11.34 GB, single=432.71 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:03:06,785 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.27 MB of total=11.37 GB 2014-08-20 22:03:07,114 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.27 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:03:07,118 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.28 MB, total=11.34 GB, single=433.14 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:03:17,118 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.89 MB of total=11.37 GB 2014-08-20 22:03:17,481 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.89 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:03:17,485 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.89 MB, total=11.34 GB, single=433.05 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:03:27,485 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.50 MB of total=11.37 GB 2014-08-20 22:03:27,808 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.50 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:03:27,840 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.51 MB, total=11.34 GB, single=432.46 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:03:37,840 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.16 MB of total=11.37 GB 2014-08-20 22:03:38,181 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.16 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:03:38,185 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.16 MB, total=11.34 GB, single=432.30 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:03:39,246 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 22:03:39,246 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 22:03:39,246 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:46895 because read count=-1. Number of active connections: 11 2014-08-20 22:03:39,246 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 22:03:39,246 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 22:03:48,185 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.11 MB of total=11.37 GB 2014-08-20 22:03:48,515 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.11 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:03:48,519 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.12 MB, total=11.34 GB, single=432.48 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:03:58,519 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.15 MB of total=11.37 GB 2014-08-20 22:03:58,890 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.15 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:03:58,894 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.16 MB, total=11.34 GB, single=431.18 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:04:08,915 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.76 MB of total=11.37 GB 2014-08-20 22:04:09,255 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.76 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 22:04:09,258 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.77 MB, total=11.34 GB, single=431.25 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 22:04:19,259 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.45 MB of total=11.37 GB 2014-08-20 22:04:19,617 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.45 MB from BlockBucket{name=multi, totalSize=10.94 GB, bucketSize=5.67 GB} 2014-08-20 22:04:19,621 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.45 MB, total=11.34 GB, single=431.20 MB, multi=10.94 GB, memory=91.23 KB 2014-08-20 22:04:29,621 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.47 MB of total=11.37 GB 2014-08-20 22:04:29,944 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.47 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:04:29,948 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.48 MB, total=11.34 GB, single=431.50 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:04:39,948 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.48 MB of total=11.37 GB 2014-08-20 22:04:40,274 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.48 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:04:40,278 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.48 MB, total=11.34 GB, single=433.13 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:04:50,278 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.57 MB of total=11.37 GB 2014-08-20 22:04:50,598 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.57 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:04:50,630 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.57 MB, total=11.34 GB, single=433.72 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:05:00,631 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.16 MB of total=11.37 GB 2014-08-20 22:05:00,968 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.16 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:05:00,971 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.16 MB, total=11.34 GB, single=435.08 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:05:10,971 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 29.38 MB of total=11.37 GB 2014-08-20 22:05:11,301 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 29.38 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:05:11,305 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=29.39 MB, total=11.34 GB, single=435.43 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:05:21,312 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.31 MB of total=11.37 GB 2014-08-20 22:05:21,644 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.31 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:05:21,648 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.32 MB, total=11.34 GB, single=436.12 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:05:31,648 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 28.60 MB of total=11.37 GB 2014-08-20 22:05:31,981 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 28.60 MB from BlockBucket{name=multi, totalSize=10.93 GB, bucketSize=5.67 GB} 2014-08-20 22:05:31,985 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=28.60 MB, total=11.34 GB, single=435.88 MB, multi=10.93 GB, memory=91.23 KB 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=3,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53332 because read count=-1. Number of active connections: 10 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,728 DEBUG [RpcServer.reader=2,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53331 because read count=-1. Number of active connections: 9 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,728 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53326 because read count=-1. Number of active connections: 8 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,728 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53328 because read count=-1. Number of active connections: 7 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,728 DEBUG [RpcServer.reader=6,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53325 because read count=-1. Number of active connections: 6 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,728 DEBUG [RpcServer.reader=0,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53329 because read count=-1. Number of active connections: 5 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=4,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53322 because read count=-1. Number of active connections: 10 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,728 DEBUG [RpcServer.reader=1,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53330 because read count=-1. Number of active connections: 3 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: Caught exception while reading:Connection reset by peer 2014-08-20 22:05:39,729 DEBUG [RpcServer.reader=5,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53323 because read count=-1. Number of active connections: 2 2014-08-20 22:05:39,727 DEBUG [RpcServer.reader=7,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.56:53327 because read count=-1. Number of active connections: 10 2014-08-20 22:05:41,985 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free 21.11 MB of total=11.36 GB 2014-08-20 22:05:42,143 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: freeing 21.11 MB from BlockBucket{name=multi, totalSize=10.92 GB, bucketSize=5.67 GB} 2014-08-20 22:05:42,145 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction completed; freed=21.12 MB, total=11.34 GB, single=435.00 MB, multi=10.92 GB, memory=91.23 KB 2014-08-20 22:05:52,145 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:06:02,146 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:06:12,147 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:06:22,147 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:06:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.34 GB, freeSize=611.16 MB, max=11.94 GB, blockCount=721596, accesses=85207349, hits=83545156, hitRatio=98.05%, , cachingAccesses=85207337, cachingHits=83545144, cachingHitsRatio=98.05%, evictions=793, evicted=940473, evictedPerRun=1185.968505859375 2014-08-20 22:06:32,148 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:06:38,598 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 22:06:38,599 DEBUG [htable-pool36-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 22:06:38,599 DEBUG [htable-pool36-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 22:06:38,599 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:47087; # active connections: 1 2014-08-20 22:06:38,600 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 22:06:38,604 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 240 2014-08-20 22:06:42,148 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:06:52,149 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:07:02,149 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:07:12,150 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:07:22,150 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:07:32,151 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:07:42,152 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:07:52,152 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:08:02,153 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:08:12,153 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:08:22,154 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:08:32,154 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:08:38,629 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 22:08:38,629 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 22:08:38,629 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 22:08:38,629 DEBUG [RpcServer.reader=8,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:47087 because read count=-1. Number of active connections: 1 2014-08-20 22:08:38,629 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 22:08:42,155 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:08:52,155 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:09:02,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:09:12,156 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:09:22,157 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:09:32,158 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:09:42,158 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:09:52,159 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:10:02,159 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:10:12,160 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:10:22,160 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:10:32,161 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:10:42,162 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:10:52,162 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:11:02,163 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:11:12,163 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:11:22,164 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:11:30,817 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=11.34 GB, freeSize=611.16 MB, max=11.94 GB, blockCount=721596, accesses=85207361, hits=83545168, hitRatio=98.05%, , cachingAccesses=85207349, cachingHits=83545156, cachingHitsRatio=98.05%, evictions=823, evicted=940473, evictedPerRun=1142.737548828125 2014-08-20 22:11:32,164 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:11:38,599 DEBUG [htable-pool37-t1] ipc.RpcClient: Use SIMPLE authentication for service ClientService, sasl=false 2014-08-20 22:11:38,599 DEBUG [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 active regionserver(s) 2014-08-20 22:11:38,599 DEBUG [htable-pool37-t1] ipc.RpcClient: Connecting to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 22:11:38,599 DEBUG [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: connection from 206.190.52.55:47265; # active connections: 1 2014-08-20 22:11:38,600 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: starting, connections 1 2014-08-20 22:11:38,605 DEBUG [CatalogJanitor-hor17n36:16020] client.ScannerCallableWithReplicas: Closing scanner 241 2014-08-20 22:11:42,165 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:11:52,166 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:12:02,166 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:12:12,167 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:12:22,167 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:12:32,168 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:12:42,169 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:12:52,169 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:13:02,170 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:13:12,170 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:13:22,171 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:13:32,171 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:13:38,632 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: marking at should close, reason: idle connection closed with 0 pending request(s) 2014-08-20 22:13:38,632 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: closing ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 2014-08-20 22:13:38,633 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: ipc connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed 2014-08-20 22:13:38,634 DEBUG [IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase] ipc.RpcClient: IPC Client (129672157) connection to hor17n36.gq1.ygridcore.net/206.190.52.55:16020 from hbase: stopped, connections 0 2014-08-20 22:13:38,632 DEBUG [RpcServer.reader=9,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: DISCONNECTING client 206.190.52.55:47265 because read count=-1. Number of active connections: 1 2014-08-20 22:13:42,172 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:13:52,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:14:02,173 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:14:12,174 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:14:22,174 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:14:32,175 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:14:42,175 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:14:52,176 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:15:02,177 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB Wed Aug 20 22:15:09 UTC 2014 Terminating master 2014-08-20 22:15:09,774 INFO [Shutdown] mortbay.log: Shutdown hook executing 2014-08-20 22:15:09,774 INFO [Shutdown] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:60010 2014-08-20 22:15:09,813 INFO [Thread-6] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@22a9f8b2 2014-08-20 22:15:09,813 INFO [Thread-6] regionserver.HRegionServer: STOPPED: Shutdown hook 2014-08-20 22:15:09,813 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2014-08-20 22:15:09,814 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: Stopping infoServer 2014-08-20 22:15:09,814 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2014-08-20 22:15:09,814 INFO [SplitLogWorker-hor17n36.gq1.ygridcore.net,16020,1408564290615] regionserver.SplitLogWorker: SplitLogWorker hor17n36.gq1.ygridcore.net,16020,1408564290615 exiting 2014-08-20 22:15:09,875 INFO [Shutdown] mortbay.log: Shutdown hook complete 2014-08-20 22:15:09,896 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] mortbay.log: Stopped SelectChannelConnector@0.0.0.0:60030 2014-08-20 22:15:09,997 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2014-08-20 22:15:09,997 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.nonceCleaner] regionserver.ServerNonceManager$1: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.nonceCleaner exiting 2014-08-20 22:15:09,997 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2014-08-20 22:15:09,997 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker] regionserver.HRegionServer$CompactionChecker: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.compactionChecker exiting 2014-08-20 22:15:09,997 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2014-08-20 22:15:09,997 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2014-08-20 22:15:09,997 TRACE [main.LruBlockCache.EvictionThread] hfile.LruBlockCache: Block cache LRU eviction started; Attempting to free -7.21 KB of total=11.34 GB 2014-08-20 22:15:10,053 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] handler.CloseRegionHandler: Processing close of TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 22:15:10,054 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 22:15:10,054 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 22:15:10,054 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: stopping server hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 22:15:10,055 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2014-08-20 22:15:10,055 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Closing TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1.: disabling compactions & flushes 2014-08-20 22:15:10,056 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.CompactSplitThread: Waiting for Split Thread to finish... 2014-08-20 22:15:10,056 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.CompactSplitThread: Waiting for Merge Thread to finish... 2014-08-20 22:15:10,056 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.CompactSplitThread: Waiting for Large Compaction Thread to finish... 2014-08-20 22:15:10,056 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.CompactSplitThread: Waiting for Small Compaction Thread to finish... 2014-08-20 22:15:10,056 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closing TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536.: disabling compactions & flushes 2014-08-20 22:15:10,056 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closing TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6.: disabling compactions & flushes 2014-08-20 22:15:10,056 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 22:15:10,056 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Updates disabled for region TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 22:15:10,056 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 22:15:10,057 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: Waiting on 12 regions to close 2014-08-20 22:15:10,057 DEBUG [RS_CLOSE_META-hor17n36:16020-0] handler.CloseRegionHandler: Processing close of hbase:meta,,1.1588230740 2014-08-20 22:15:10,058 DEBUG [RS_CLOSE_META-hor17n36:16020-0] regionserver.HRegion: Closing hbase:meta,,1.1588230740: disabling compactions & flushes 2014-08-20 22:15:10,058 DEBUG [RS_CLOSE_META-hor17n36:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2014-08-20 22:15:10,247 INFO [StoreCloserThread-TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,370 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,376 INFO [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closed TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 22:15:10,376 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Closed TestTable,00000000000000000094371840,1407173209701.b67f1ed699b2b31d5360b0f8245839a6. 2014-08-20 22:15:10,377 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Processing close of hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 22:15:10,378 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closing hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0.: disabling compactions & flushes 2014-08-20 22:15:10,378 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Updates disabled for region hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 22:15:10,401 DEBUG [RS_CLOSE_META-hor17n36:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2014-08-20 22:15:10,401 INFO [RS_CLOSE_META-hor17n36:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2014-08-20 22:15:10,402 DEBUG [RS_CLOSE_META-hor17n36:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2014-08-20 22:15:10,466 INFO [StoreCloserThread-hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,469 INFO [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closed hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 22:15:10,469 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Closed hbase:namespace,,1406162325470.221216a6df76088820c4d89a24c66fa0. 2014-08-20 22:15:10,469 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 22:15:10,470 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closing TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23.: disabling compactions & flushes 2014-08-20 22:15:10,470 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 22:15:10,522 INFO [StoreCloserThread-TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,525 INFO [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closed TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 22:15:10,525 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Closed TestTable,00000000000000000010485760,1407173209701.67414220d844ede17df98e3f63fb0536. 2014-08-20 22:15:10,525 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 22:15:10,526 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closing TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d.: disabling compactions & flushes 2014-08-20 22:15:10,526 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 22:15:10,526 INFO [StoreCloserThread-TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,528 INFO [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Closed TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 22:15:10,528 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] handler.CloseRegionHandler: Closed TestTable,,1407173209701.35556b0cd9ee4aeb9ccdef2e502703d1. 2014-08-20 22:15:10,528 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 22:15:10,529 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Closing TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3.: disabling compactions & flushes 2014-08-20 22:15:10,529 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 22:15:10,598 INFO [StoreCloserThread-TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,598 INFO [StoreCloserThread-TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,601 INFO [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Closed TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 22:15:10,601 INFO [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closed TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 22:15:10,601 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] handler.CloseRegionHandler: Closed TestTable,00000000000000000052428800,1407173209701.647e9e38812e56782b2802d9f8a216c3. 2014-08-20 22:15:10,601 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Closed TestTable,00000000000000000073400320,1407173209701.6246293acada9511ad1ed27a2c136b3d. 2014-08-20 22:15:10,601 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 22:15:10,601 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 22:15:10,602 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Closing TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce.: disabling compactions & flushes 2014-08-20 22:15:10,602 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closing TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06.: disabling compactions & flushes 2014-08-20 22:15:10,602 DEBUG [RS_CLOSE_REGION-hor17n36:16020-0] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 22:15:10,602 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 22:15:10,661 INFO [StoreCloserThread-TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,664 INFO [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closed TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 22:15:10,664 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Closed TestTable,00000000000000000062914560,1407173209701.9b4e77649e34b8667cb655ed6788ae06. 2014-08-20 22:15:10,664 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 22:15:10,664 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closing TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a.: disabling compactions & flushes 2014-08-20 22:15:10,664 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 22:15:10,698 INFO [StoreCloserThread-TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,699 INFO [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closed TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 22:15:10,699 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Closed TestTable,00000000000000000031457280,1407173209701.484fab46de6b0ae27958354313d20b23. 2014-08-20 22:15:10,699 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 22:15:10,700 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closing TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370.: disabling compactions & flushes 2014-08-20 22:15:10,700 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 22:15:10,729 INFO [hor17n36.gq1.ygridcore.net,16020,1408564290615.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor: hor17n36.gq1.ygridcore.net,16020,1408564290615.splitLogManagerTimeoutMonitor exiting 2014-08-20 22:15:10,735 INFO [StoreCloserThread-TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,737 INFO [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closed TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 22:15:10,738 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Closed TestTable,00000000000000000083886080,1407173209701.a0333fe1d1e09a008b55f6346d998370. 2014-08-20 22:15:10,810 INFO [StoreCloserThread-TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,813 INFO [RS_CLOSE_REGION-hor17n36:16020-2] regionserver.HRegion: Closed TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 22:15:10,813 DEBUG [RS_CLOSE_REGION-hor17n36:16020-2] handler.CloseRegionHandler: Closed TestTable,00000000000000000041943040,1407173209701.6eb8b87c16dd214f35e9ab2f64c4634a. 2014-08-20 22:15:10,829 FATAL [RS_CLOSE_REGION-hor17n36:16020-0] master.HMaster: Master server abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2014-08-20 22:15:10,830 FATAL [RS_CLOSE_REGION-hor17n36:16020-0] master.HMaster: Unrecoverable exception while closing region TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce., still finishing close java.io.IOException: java.io.IOException: java.lang.AssertionError: delta between reported and actual size > 5% at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1267) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1152) at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:102) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: java.io.IOException: java.lang.AssertionError: delta between reported and actual size > 5% at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:816) at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:122) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1248) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1245) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more Caused by: java.lang.AssertionError: delta between reported and actual size > 5% at org.apache.hadoop.hbase.io.hfile.LruBlockCache.assertCounterSanity(LruBlockCache.java:365) at org.apache.hadoop.hbase.io.hfile.LruBlockCache.evictBlock(LruBlockCache.java:487) at org.apache.hadoop.hbase.io.hfile.LruBlockCache.evictBlock(LruBlockCache.java:444) at org.apache.hadoop.hbase.io.hfile.LruBlockCache.evictBlocksByHfileName(LruBlockCache.java:463) at org.apache.hadoop.hbase.io.hfile.HFileReaderV2.close(HFileReaderV2.java:541) at org.apache.hadoop.hbase.regionserver.StoreFile$Reader.close(StoreFile.java:1102) at org.apache.hadoop.hbase.regionserver.StoreFile.closeReader(StoreFile.java:475) at org.apache.hadoop.hbase.regionserver.HStore$2.call(HStore.java:798) at org.apache.hadoop.hbase.regionserver.HStore$2.call(HStore.java:795) ... 6 more 2014-08-20 22:15:10,832 ERROR [RS_CLOSE_REGION-hor17n36:16020-0] executor.EventHandler: Caught throwable while processing event M_RS_CLOSE_REGION java.lang.RuntimeException: java.io.IOException: java.io.IOException: java.lang.AssertionError: delta between reported and actual size > 5% at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:115) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: java.io.IOException: java.io.IOException: java.lang.AssertionError: delta between reported and actual size > 5% at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1267) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1152) at org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:102) ... 4 more Caused by: java.io.IOException: java.lang.AssertionError: delta between reported and actual size > 5% at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:816) at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:122) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1248) at org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1245) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more Caused by: java.lang.AssertionError: delta between reported and actual size > 5% at org.apache.hadoop.hbase.io.hfile.LruBlockCache.assertCounterSanity(LruBlockCache.java:365) at org.apache.hadoop.hbase.io.hfile.LruBlockCache.evictBlock(LruBlockCache.java:487) at org.apache.hadoop.hbase.io.hfile.LruBlockCache.evictBlock(LruBlockCache.java:444) at org.apache.hadoop.hbase.io.hfile.LruBlockCache.evictBlocksByHfileName(LruBlockCache.java:463) at org.apache.hadoop.hbase.io.hfile.HFileReaderV2.close(HFileReaderV2.java:541) at org.apache.hadoop.hbase.regionserver.StoreFile$Reader.close(StoreFile.java:1102) at org.apache.hadoop.hbase.regionserver.StoreFile.closeReader(StoreFile.java:475) at org.apache.hadoop.hbase.regionserver.HStore$2.call(HStore.java:798) at org.apache.hadoop.hbase.regionserver.HStore$2.call(HStore.java:795) ... 6 more 2014-08-20 22:15:10,858 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Processing close of TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 22:15:10,858 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closing TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce.: disabling compactions & flushes 2014-08-20 22:15:10,858 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Updates disabled for region TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 22:15:10,859 INFO [StoreCloserThread-TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce.-1] regionserver.HStore: Closed info 2014-08-20 22:15:10,861 INFO [RS_CLOSE_REGION-hor17n36:16020-1] regionserver.HRegion: Closed TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 22:15:10,861 DEBUG [RS_CLOSE_REGION-hor17n36:16020-1] handler.CloseRegionHandler: Closed TestTable,00000000000000000020971520,1407173209701.df92c867f561868284729e0deeb615ce. 2014-08-20 22:15:11,058 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: stopping server hor17n36.gq1.ygridcore.net,16020,1408564290615; all regions closed. 2014-08-20 22:15:11,058 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] wal.FSHLog: Closing WAL writer in hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 22:15:11,092 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] wal.FSHLog: Closing WAL writer in hdfs://hor17n36.gq1.ygridcore.net:8020/apps/hbase/data/WALs/hor17n36.gq1.ygridcore.net,16020,1408564290615 2014-08-20 22:15:11,125 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] wal.FSHLog: Moved 2 WAL file(s) to /apps/hbase/data/oldWALs 2014-08-20 22:15:11,133 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] ipc.RpcClient: Stopping rpc client 2014-08-20 22:15:11,133 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.Leases: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closing leases 2014-08-20 22:15:11,133 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.Leases: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020 closed leases 2014-08-20 22:15:11,133 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] master.HMaster: Stopping master jetty server 2014-08-20 22:15:12,033 INFO [RS_OPEN_META-hor17n36:16020-0-MetaLogRoller] regionserver.LogRoller: LogRoller exiting. 2014-08-20 22:15:16,515 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.periodicFlusher] regionserver.HRegionServer$PeriodicMemstoreFlusher: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.periodicFlusher exiting 2014-08-20 22:15:16,898 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.leaseChecker] regionserver.Leases: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.leaseChecker closing leases 2014-08-20 22:15:16,898 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.leaseChecker] regionserver.Leases: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.leaseChecker closed leases 2014-08-20 22:15:17,158 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2014-08-20 22:15:17,176 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x14765cd18ff04ea 2014-08-20 22:15:17,184 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.ZooKeeper: Session: 0x14765cd18ff04ea closed 2014-08-20 22:15:17,185 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020-EventThread] zookeeper.ClientCnxn: EventThread shut down 2014-08-20 22:15:17,185 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] ipc.RpcClient: Stopping rpc client 2014-08-20 22:15:17,186 DEBUG [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] master.HMaster: Stopping service threads 2014-08-20 22:15:17,186 INFO [hor17n36.gq1.ygridcore.net,16020,1408564290615-ClusterStatusChore] balancer.ClusterStatusChore: hor17n36.gq1.ygridcore.net,16020,1408564290615-ClusterStatusChore exiting 2014-08-20 22:15:17,186 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.archivedHFileCleaner] cleaner.HFileCleaner: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.archivedHFileCleaner exiting 2014-08-20 22:15:17,186 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] cleaner.LogCleaner: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner exiting 2014-08-20 22:15:17,186 INFO [CatalogJanitor-hor17n36:16020] master.CatalogJanitor: CatalogJanitor-hor17n36:16020 exiting 2014-08-20 22:15:17,186 INFO [hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore] balancer.BalancerChore: hor17n36.gq1.ygridcore.net,16020,1408564290615-BalancerChore exiting 2014-08-20 22:15:17,186 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] master.ReplicationLogCleaner: Stopping replicationLogCleaner-0x14765cd18ff04e9, quorum=hor17n36.gq1.ygridcore.net:2181, baseZNode=/hbase 2014-08-20 22:15:17,201 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020.oldLogCleaner] zookeeper.ZooKeeper: Session: 0x14765cd18ff04e9 closed 2014-08-20 22:15:17,201 INFO [ActiveMasterManager-EventThread] zookeeper.ClientCnxn: EventThread shut down 2014-08-20 22:15:17,214 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] flush.MasterFlushTableProcedureManager: stop: server shutting down. 2014-08-20 22:15:17,214 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] ipc.RpcServer: Stopping server on 16020 2014-08-20 22:15:17,214 INFO [RpcServer.listener,port=16020] ipc.RpcServer: RpcServer.listener,port=16020: stopping 2014-08-20 22:15:17,215 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopped 2014-08-20 22:15:17,215 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: stopping 2014-08-20 22:15:17,235 INFO [main-EventThread] zookeeper.RegionServerTracker: RegionServer ephemeral node deleted, processing expiration [hor17n36.gq1.ygridcore.net,16020,1408564290615] 2014-08-20 22:15:17,264 WARN [main-EventThread] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=hor17n36.gq1.ygridcore.net:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/rs 2014-08-20 22:15:17,264 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] zookeeper.ZooKeeper: Session: 0x14765cd18ff04e7 closed 2014-08-20 22:15:17,264 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: stopping server hor17n36.gq1.ygridcore.net,16020,1408564290615; zookeeper connection closed. 2014-08-20 22:15:17,264 INFO [main-EventThread] util.RetryCounter: Sleeping 1000ms before retry #0... 2014-08-20 22:15:17,264 INFO [master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020] regionserver.HRegionServer: master/hor17n36.gq1.ygridcore.net/206.190.52.55:16020 exiting 2014-08-20 22:15:17,265 INFO [Thread-6] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2014-08-20 22:15:17,266 INFO [Thread-6] regionserver.ShutdownHook: Shutdown hook finished.